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ABSTRACT 

In response to legislative mandate, the California 
Postsecondary Education Commission developed options for improving 
students 1 learning and development in college, including funding 
approaches designed to support these options. The commission's report 
summarizes a previous, related report and traces the origins of the 
current report from it, describes the three major types of state 
incentive funding programs presently used in American higher 
education, discusses current thinking regarding talent development 
and value-added assessment of student gains in higher education, and 
outlines two major priorities for incentive funding in California: 
achievement of broad student access and success, and the recruitment 
of more women and ethnic minorities in teacher training. The 
commission's four recommendations include: (1) establishment of a 
state challenge grants program to support initiatives for improving 
teaching and learning, including development of institutional 
assessment plans; (2) a state challenge grants program to support 
initiatives for increasing underrepresented students in teacher 
education in the state at all levels; (3) development of appropriate 
criteria and mechanisms for effective implementation, administrcttion, 
and evaluation of the challenge grant programs; and (4) support for 
development of a statewide student information system to track 
individual students throughout their college experience and beyond. 
Related materials are appended, including a paper on higher education 
assessment in the United States and in California. Contains 25 
references. (MSE) 



Executive Summary 

This report, prepared by Martin M Ahumada, responds to Assembly Bill 
2016 of 1987, which directed the Commission to "develop and present op- 
tions" for "measuring and implementing talent development or value added 
approaches to higher education," and "an incentive funding approach design- 
ed to develop appropriate methods of assessing the teaching and learning 
process." 

• Part One on pages 1-4 of the report presents six conclusions and four rec- 
ommendations regarding these several approaches. 

• Part Two on page 5-8 summarizes the Commission's previous report on 
the topic and traces the origins of the current report from it. 

• Part Three on pages 9-14 describes the three major types of state incentive 
funding programs presently being used in American higher education. 

• Part Four on pages 15-20 discusses current thinking regarding talent de- 
velopment and value-added assessment in higher education. 

• And Part Five on pages 21-26 outlines two major priorities for incentive 
funding in California - achievement of broad scudent access and success, 
and more women and ethnic minorities in the teaching "pipeline." 

The four recommendations of the report are that: 

1 The Governor and Legislature should establish a California challenge 
grants program to support initiatives for improving teaching and learn- 
ing in higher education, including the development of institutional as- 
sessment plans. 

2 The Governor and Legislature should establish a California challenge 
grants program to support initiatives for increasing the number of under- 
represented students in the teaching "pipeline** in California education at 
all levels. 

3. The California Postsecondary Education Commission, in collaboration 
with the segments and the Intersegmental Coordinating Council, should 
(1) develop the appropriate criteria and mechanisms for the effective im- 
plementation, administration, and evaluation of the challenge grants pro- 
grams recommended above, and (2) determine their appropriate roles in 
the administration and the evaluation of these programs. 

4. The Governor and Legislature should encourage and support the devel- 
opment of a statewide student information system that is designed to 
track individual students throughout their collegiate experience and bey- 
ond, in order to better understand the factors that influence student ac- 
cess and retention and to assess the impact of program changes on student 
performance. 

The Commission adopted this report at its meeting on December 12, 1988, on 
recommendation of its Policy Development Committee Additional copies of 
the report and more information about it may be obtained from the Library 
of the Commission at (916) 322-8031. 
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Conclusions and Recommendations 



PROMOTING edi'cational quality through assess- 
ment and state budgetary strategies is one of the 
most discussed issues in American higher education 
today. In California, through AB 2016 of 1987 (Hay- 
den), the Legislature asked the Pcstsecondary Edu- 
cation Commission to develop options for measuring 
and improving students 9 learning and development 
in college, including funding approaches designed to 
support these options. 

The Commission submits this report in response to 
that request. In this first section, it summarizes its 
findings that it develops at greater length later in 
the report, and it offers four recommendations based 
on those conclusions. 



Conclusions 

1. Institutional excellence is most likely to be 
assured when states encourage their education* 
al institutions periodically to review and sharp- 
en their mission and functions* define and mea- 
sure essential student learning, and adopt the 
appropriate organizational, structural, and eval- 
uation systems to ensure that they meet their 
objectives. 

In recent years, a number of states have used their 
state budgets in different ways to promote quality in 
higher education. In almost all cases, state leaders 
contend that their funding strategies are premised 
on widely accepted views of what constitutes sound 
educational processes to improve institutional per- 
formance. The experience of these states indicates 
that reliance on financial incentives to promote edu- 
cational quality is more effective than punitive reg- 
ulation. State incentive funding strategies in parti- 
cular are increasingly being viewed as important 
tools or means for encouraging educational institu- 
tions to become self-evaluative and to embark on 
new institutional and state priorities for higher edu- 
cation. 



2. State incentive funding programs are bud- 
getary means to achieving the State's policy 
goals for higher education, rather than ends in 
themselves. They provide marginal increments 
or "add ons" to institutions 9 base budgets that 
state leaders can use for leverage in inducing in- 
stitutions to engage in certain intended or desir- 
able activities or to achieve specific ends. 

States can stimulate much educational improvement 
and faculty and institutional creativity from a small 
amount of new money above current funding levels - 
in the range of 1 percent to 2 percent of the total 
state budget for higher education. Incentive funding 
initiatives that best respond to states' interests are 
those designed as a means for (1) assisting students 
to make better informed decisions related to their 
educational needs and interests, and (2) assisting 
faculty members and institutions to determine 
which educational interventions will most likely pro- 
mote student success. These initiatives would sup- 
port locally developed rather than externally impos- 
ed methods for assessing, guiding and improving the 
teaching and learning process, but they can be ex- 
pected to demonstrate institutional effectiveness to 
state leaders and other constituencies. 

3. "Challenge grant" programs that are estab- 
lished on a multiple-year and entitlement basis 
and are designed to supplement the existing 
competitive grant programs of the segments are 
most likely to achieve California's priorities for 
its higher education institutions. 

Three nutfor types of state-level incentive funding 
approaches exist for improving higher education: (1) 
performance-based funding, (2) competitive grants, 
and (3) challenge grants. Competitive grant pro- 
grams operated on an appropriate scale, such as the 
current segment-based programs in California, can 
be effective in encouraging institutional creativity 
and experimentation, as evidenced by the success of 
projects funded by the California State University's 
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Academic Program Improvement Fund, the Univer- 
sity of California's Instructional Improvement Fund, 
and the California Community Colleges' Fund for 
Instructional Improvement. For example, the ori- 
gins of the California Academic Partnership Pro- 
gram and the State University's English Placement 
Examination can be traced to pilot projects funded 
by its Academic Program Improvement Fund. 

Yet challenge grants provide state leaders a power- 
ful tool to channel appropriate types of incentives tc 
appropriate levels - institutional, departmental, or 
individual - on the campuses, in order to encourage 
all institutions, rather than only those that win com- 
petitive grants, to achieve specific state objectives. 

4. Value-added assessments should be design* 
ed to examine a variety of student and institu- 
tional outcomes through the application of mul- 
tiple procedures that are developed with the 
full involvement of students and faculty and 
that are tailored to suit the needs of a particular 
course, program, or institution as part of a sys- 
tematic and ongoing process of self-study and 
self-improvement 

"Value-added" assessment is an approach to mea- 
suring changes or gains in students' knowledge, at- 
titudes, and skills between the beginning and the 
end of their collegiate experience. For several rea- 
sons, this approach must be carefully planned, de- 
signed, developed, and applied in order to be appro- 
priate to the multiplicity of contexts found in Cali- 
fornia higher education. The best use of value-added 
assessment information is to track or chart student 
growth and change over time for improving the 
teaching-learning process and for promoting student 
success. Correctly developed and utilized v lue-add- 
ed assessment information promises to result in ma- 
jor improvements in teaching and learning, but 
significant risks are associated with this informa- 
tion if it is inappropriately developed or misused. 
Most importantly, it is inappropriate to use value- 
added assessment data to drive the state budgeting 
process, to justify punitive measures against a pro- 
gram or institution, to compare one institution with 
others rather than with itself over time, or to rely on 
it to any significant degree in decisions related to 
faculty retention and tenure. 



5. "Quality" and "diversity" are interdependent 
goals for California higher education that in- 
centive funding should help achieve. 

Expanding views of what constitutes "quality" in 
California higher education are emerging from che 
ongoing dialogue about how the State's higher edu- 
cation institutions can best respond to the education- 
al needs of their rapidly changing student popula- 
tion. For example, the issue of achieving greater 
student and faculty diversity in all California insti- 
tutions of higher learning as well as greater multi- 
cultural and international awareness across the cur- 
riculum has emerged as a priority "quality" initia- 
tive at the State and campus levels. Thus the terms 
quality and diversity are increasingly interdepen- 
dent as State goals for higher education, premised on 
the notion that educational institutions fall short of 
providing a "quality" educational experience if they 
do not familiarize students with the socioeconomic 
and cultural character of the larger society in which 
they live and do not educate broadly among the di- 
verse groups comprising a multicultural society. 

6. California's priorities that should be served 
through incentive funding programs are de- 
monstrable improvements in institutions' effec- 
tiveness in achieving (1) greater student access 
and success plus (2) greater faculty diversity. 

In light of the changing demographics of California, 
the State's limited resources to support incentive 
funding programs should be targeted at achieving its 
priority goals of encouraging institutions to help all 
students succeed by improving their skills, knowl- 
edge, and motivation; improve the access, retention, 
and completion rates of underrepresented students; 
and support those initiatives that attract, prepare 
and retain women and ethnic minority faculty. 



Recommendations 

Based on the above conclusions, the Commission 
offers the following four recommendations regarding 
budget initiatives to address the priorities facing 
California higher education: 



RECOMMENDATION 1: The Governor and 
Legislature should establish a California chal- 
lenge grants program to support initiatives for 
improving teaching and learning in higher edu- 
cation, including the development of institu- 
tional assessment plans. 

RECOMMENDATION 2: The Governor and 
Legislature should establish a California chal- 
lenge grants program to support initiatives for 
increasing the number of underrepresented 
students in the teaching "pipeline" in California 
education at all levels. 

RECOMMENDATION 3: The California Post- 
secondary Education Commission, in collabor- 
ation with the segments and the Intersegmental 
Coordinating Council, should (1) develop the 
appropriate criteria and mechanisms for the ef- 
fective implementation, administration, and 
evaluation of the challenge grants programs 
recommended above, and (2) determine their 
appropriate roles in the administration and the 
evaluation of these programs. 

RECOMMENDATION 4: The Governor and 
Legislature should encourage and support the 
development of a statewide student information 
system that is designed to track individual stu- 
dents throughout their collegiate experience 
and beyond, in order to better understand the 
factors that influence student access and re- 
tention and to assess the impact of program 
changes on student performance. 



Scope of the remainder of the report 

The Commission devotes the rest of this report to the 
rationale for these recommendations by focusing on 
two major issues: (1) developing the most appro- 
priate State-levd incentive funding strategies or 
"options" for California's colleges and universities, 
and (2) aiming these strategies at the most critical 
issues facing these institutions. 

In Part Two of the report, the Commission explains 
the origins and development of the study that 'ed to 
this document. 

In Part Three, it describes the three major state- 
level funding approaches at work across the nation 
to promote educational quality (performance-based 
funding, competitive grant programs, and challenge 
grant programs) and reviews their primary aims, 
administration and funding. 

In Part Four, it discusses "talent development" and 
"value-added" assessment and describes the pur- 
poses and uses of this method cf assessment in high- 
er education, noting the arguments that have been 
made for and against its application in various set- 
tings. 

And in Part Five, it identifies the priority quality 
initiatives in California higher education that 
should be supported through State incentive funding 
and that form the basis of the preceding recommen- 
dations. 
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Origins and Background of the Report 



SEVERAL forces have catapulted the issue of pro- 
moting educational quality through assessment and 
state budget strategies to center stage on the public 
policy agenda: 

1. Reports of several distinguished national panels 
in recent years have stressed the need to improve 
education by assessing and enhancing the teach- 
ing-learning process. 

2. Faced with major fiscal constraints, state legisla- 
tors, citizen groups, and other constituents of 
higher education have sought evidence that pub- 
lic funds for educational purposes are used effec- 
tively. 

3. The fact that public higher education is an in- 
creasingly diverse enterprise serving a variety of 
students has prompted public officials to ask how 
well it serves these different groups. 

4. State leaders have sought new funding approach- 
es that will provide institutions the types of incen- 
tives that are effective in addressing some of the 
new priorities facing higher education. 

5. Finally, there is a growing interest in student out- 
comes assessment as a means to promoting great- 
er institutional self-awareness and thus help im- 
prove curricular offerings, instructional processes, 
student services, and other practices necessary to 
achieve educational excellence. 

It was vith these concerns in ir'nd that the Legisla- 
ture asKed the Commission to de/elop options for 
measuring and improving students' learning and de- 
velopment in college, including funding approaches 
designed to support these options. 



Impetus for the study 

In 1986, through Assembly Concurrent Resolution 
141 (Hayden), the Legislature directed the Postsec- 
ondary Education Commission to study "talent de- 
velopment, value-added, and performance-based 



budgeting approaches to measuring and improving 
the quality of higher education." In response, the 
Commission published its report, Funding Excel- 
lence in California Higher Education, in March 1987. 

In that report, the Commission reviewed the litera- 
ture on outcomes assessment in higher education 
and described the major approaches being taken cur- 
rently by state and institutions elsewhere in the na- 
tion. It also examined state-level strategies to fund 
excellence in higher education and presented six 
"guiding principles" for developing viable state-level 
strategies for measuring and improving quality in 
higher education (pp. 11-13). Paraphrased, these 
principles advocate that: 

1. State funds to improve quality in higher educa- 
tion should be supplementary to institutions' base 
budget. 

2. Value-added assessments are of greatest value 
when linked with other student and institutional 
data. 

3. Outcomes measurement must be sensitive to dif- 
ferences in missions and goals of the State's col- 
leges and universities. 

4. The thrust of quality improvement should be to 
assist faculty and students to improve the teach- 
ing process and enhance learning, and the defini- 
tion and assessment of student outcomes should 
be primarily a faculty responsibility. 

5. State-level quality improvement strategies should 
be developed carefully, phased in gradually, and 
reevaluated frequently. 

6. Appropriate assessment is just one of several in- 
stitutional practices that must exist in order to 
achieve institutional excellence. 

Under these principles, state policy leaders have a 
legitimate interest in examining the objectives of 
their state's institutions of higher learning and in 
obtaining evidence that public funds for educational 
purposes are used for maximum effectiveness. In es- 
tablishing state-level approaches to improving qual- 
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ity in higher education, these leaders can justifiably 
call for close attention to improvements in higher 
education and 7 particularly, to the appropriate role 
of assessment in judging these improvements. They 
also have a concomitant responsibility to uphold the 
authority of academic institutions by defining State 
goals of higher education but entrusting faculty and 
administrators with the task of determining the 
means to those goals. 

Funding Excellence in California Higher Education 
constituted only the first phase of a larger initiative 
implicit in ACR 141 - to develop, where appropriate, 
options for improving quality in California higher 
education. The Legislature explicitly requested de- 
velopment of these options through Assembly Bill 
2016 (Hayden; enacted as Chapter 1296, Statutes of 
1987, and reproduced in Appendix A), which direct- 
ed the Commission to "develop and present possible 
options" for "measuring and implementing talent 
development or value added approaches to higher 
education," and "an incentive funding approach de- 
signed to develop appropriate methods of assessing 
the teaching and learning process." 

Therefore, this study both completes the second 
yhase of the ACR 141 directive and also responds to 
AB 2016. 



Scope and conduct of the study 

In conducting the study, the Commission staff fo- 
cused on: 

1. Clarifying the most appropriate responsibilities 
and challenges at the campus, segmental, and 
state levels regarding (1) institution! 1 practices, 
including assessment, that help students succeed 
by improving their skills, knowledge, and moti- 
vation; and (2) achievement of greater participa- 
tion and degree-completion rates of ethnic minor- 
ities and women, including their representation 
in the teaching ranks where they remain under- 
represented in specific fields of study, and 

2. Developing State incentive funding strategies or 
options for supporting such activities. 

The staff therefore conducted a nationwide survey of 
state fiscal and budgetary strategies aimed at ex- 
plicitly promoting quality improvement in higher 
education, and the results of that survey are sumirja- 
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rized in Part Three of this report. The staff ex- 
amined assessment programs, policies, and issues in 
California and other states; and its findings appear 
in Part Four and Appendix C. Finally it identified 
the specific initiatives that will most likely contri- 
bute to broad student access and success in Califor- 
nia higher education, and these initiatives are dis- 
cussed in Part Five. 



Composition and role 

of the advisory committee 

As called for by AB 2016, the Commission created an 
advisory committee representing students, faculty, 
and administrators from all segments of California 
education to assist in the conduct of the study. Its 
members were: 

• Martin M. Ahumada, Commission Staff Member, 
Chair of the Committee; 

• Edward A. Alpers, Dean of Honors and Under- 
graduate Programs, University of California, Los 
Angeles; 

• Alexander W. Astin, Director and Professor, High- 
er Education Research Institute, University of Cal- 
ifornia, Los Angeles; 

• Richard Duran, Associate Professor of Education, 
University of California, Santa Barbara; 

• Hans C. Giesecke, Assistant Vice President, Asso- 
ciation of Independent California Colleges and Uni- 
versities; 

• Bernard Goldstein, Professor of Biology, San Fran- 
cisco State University; 

• Diane F. Halpern, Professor of Psychology, Cali- 
fornia State University, San Bernardino; 

• Ronald Henderson, Professor of Education and 
Psychology, University of California, Santa Cruz; 

• Kirk L. Knutsen, then Associate Director of Legis- 
lative Affairs, University of California Student As- 
sociation (representing University of California 
students); currently on the staff of the Commis- 
sion; 

• Glenn Irvin, Associate Vice President for Academ- 
ic Affairs and University Dean, California Poly- 
technic State University, San Luis Obispo; 



• Barbara Kalbas, Vice President for Academic Af- 
fairs, Long Beach Community College District: 

• Martha Kanter, Assistant Deputy Director, Chan- 
cellor's Office, California Community Colleges; 

• Karen Merritt, Director of Academic Planning 
and Program Review, Office of the President, The 
University of California; 

• Leigh Mintz, Associate Vice President of Academ- 
ic Programs, California State University, Hay- 
ward; 

• Maria Reyes, Consultant, State Department of 
Education; 

• John Richardson, Liaison, California State Stu- 
dent Association (representing California State 
University students); 

• Laurie Riddell, Student, West Los Angeles College 
(representing California Community College stu- 
dents); 

• Robert Turley, Associate Professor of Sociology, 
San Bernardino Valley College; and 

• Frank Young, Associate Dean, Academic Affairs, 
Plans, Office of the Chancellor, The California 
State University. 



The committee met five times during the course of 
the Commission's study to review the provisions of 
the legislation, define the salient quality issues fac- 
ing the State, develop operating assumptions to 
guide the committee's work, and identify the priority 
quality initiatives that can appropriately be sup- 
ported through State incentive funding. 

Where it was possible, committee members estab- 
lished consultative or networking processes through 
which faculty, administrators, and students from 
their segment could be actively involved in the Com- 
mission's study by obtaining their views and com- 
ments on the issues under study by the committee. 
A number of Committee members provided back- 
ground papers which contributed to the development 
of this report. These processes 'vere instrumental in 
providing the Commission with perspective on the 
assessment and related issues that are central to 
academe in California and are currently under close 
examination in all segments. A sample of consulta- 
tive materials are included in Appendix B, and the 
Commission hereby expresses its gratitude to the 
members of the committee for their assistance in 
that consultation. 
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Incentive Funding by the States 



TO date, at least 18 states have mandated or are 
considering budgetary or assessment strategies ex- 
plicitly designed to promote quality in higher educa- 
tion. California is among the more recent of them, 
with AB 2016 of 1987 and its forerunner - ACR 141 
of 1986 ~ aimed at instituting State incentive-fund- 
ing and assessment as a matter of State policy or 
statute. 



Current incentive funding programs 

Of the 18 states reporting that they have a state- 
level incentive funding program, 12 of them - Cali- 
fornia, Colorado, Connecticut, Florida, Kentucky, 
Michigan, New Hampshire, New Jersey, Ohio, 
Rhode Island, Tennessee, and Virginia - have pro- 
grams directed at improving the teaching-learning 
process per $e or at better serving underrepresented 
students. The six other states - Alabama, Arkan- 
sas, Pennsylvania, Utah, Washington, and Wiscon- 
sin -- have programs concerned with such initiatives 
as economic development, endowed chair?, and tech- 
nological ini.ovation. Although this section reviews 
only the programs in the former states - as only 
these relate to the educational improvement and 
student/faculty diversity initiatives addressed in 
this study - it should be noted that in all 18 states, 
incentive funding strategies are viewed as impor- 
tant means for encouraging institutions to become 
self-evaluative and to address new institutional and 
state priorities for higher education. 

Three major types of state-level incentive funding 
approaches are currently used for improving in- 
struction end/or for better serving underrepresented 
students in higher education, all of which involve 
small increments or "add ons" to institutions' base 
budgets: 

• One approach, which is commonly referred to as 
"performance based funding," ties appropriations 
directly to measurable outcomes or demonstrated 
results, such as the increased percentage of aca- 
demic programs that have undergone peer review. 



In essence, this type of funding approach purports 
to fund educational results, while the other two 
seek to shape educational processes. 

• The other two funding approaches, which are com- 
monly referred to as "challenge grant" and "com- 
petitive grant* 9 programs, both set aside funds 
aimed at encouraging institutional practices that 
will improve institutional performance in areas 
important to the institution or the state. There are 
important distinctions between them, however. 
Challenge grant programs can be operated on a 
non-competitive basis, and they often are. That is, 
although a few state-level challenge grant pro- 
grams are funded at least partially on a competi- 
tive basis, they can be perhaps most appropriately 
viewed as entitlement programs in which most if 
not all institutions receive some funding - often 
on a multi-year basis - to address specific needs, 
provided these institutions are deemed "eligible" 
by m^ung preestablished criteria or guidelines 
for achieving program objectives. 

• The state-level "competitive-grants" approach - 
largely modeled after the federal Fund for the Im- 
provement of Postsecondary Education (FIPSE) 
on the other hand assumes that one-time seed 
money awarded totally on a competitive basis can 
be effective in encouraging a select or limited 
number of institutions to develop model programs 
that could later be adopted on a broader scale. 

Within these three categories of incentive funding 
strategies, a total of 24 programs are currently fund- 
ed in the 12 states - five "performance based" pro- 
grams, 13 "competitive grant" programs, and six 
"challenge grant" programs, as described below. 

Performance-based funding programs 

Colorado: Colorado's Program for the Recognition of 
Excellence was established in 1985 to ^ward insti- 
tutions' "demonstrated superior performance in 
achieving quality, access, diversity, accountability 
or efficiency." ^or example, fiscal rewards are pro- 
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vided for an institution-wide program-review pro- 
cess that has improved quality, a department that 
consistently produces outstanding graduates, and an 
academic mnt that has made a unique contribution 
to improving access. The criteria used in making 
Recognition of Excellence awards are: (1) outcome 
information that demonstrates excellence in achiev- 
ing a statewide goal; (2) importance to the institu- 
tion's role and mission; (3) evidence of having met an 
institution/college/department goal; and (4) quality 
of experience of the personnel involved. 

Florida: Florida operates two performance based 
funding programs: 

• Its Faculty Awards for Excellence in Instruction 
Program was established in 1983 to support indi- 
vidual faculty awards of $2,000 each in recogni- 
tion of their "outstanding performance in instruc- 
tion," based on peer and student reviews. 

• Florida created its Postsecondary Education Coop- 
eration Trust Fund in 1983 to promote a more uni- 
fied, cooperative and coordinated system of post- 
secondary education, with effective linkages 
among the various educational sectors and be- 
tween postsecondary education and the communi- 
ty. The Trust Fund's proceeds are to be used to re- 
ward institutional creativity and initiative in as- 
sisting student articulation and in cooperating 
with local business and industry, such as (1) local 
consortia and institutional arrangements; (2) or- 
ganized faculty and professional staff networks; 

(3) the use of adjunct faculty from industry; and 

(4) apprenticeships or cooperative training pro- 
grams for students. 

Ohio: Ohio established its Program Excellence Pro- 
gram in 1983 to provide one-time awards to recog- 
nize and enhance the best undergraduate programs 
in the state. The stated purposes of the program are 

(1) to recognize and reward high-quality academic 
programs at state-assisted colleges and universities; 

(2) to increase the quality of instruction through en- 
richment grants; and (3) to encourage academic ex- 
cellence in associate and baccalaureate programs. 

The following criteria are used to make the Program 
Excellence awards: 

• Program Characteristics 



Articulation of purposes and objectives; and 

Curriculum adequacy am' appropriateness to 
purpose. 

• Resource Characteristics 

Student input characteristics (SAT or ACT scores, 
etc.); 

Quality of faculty; and 

Quality of instructional resources and support- 
ing services. 

• Program Evaluation 

Performance of graduates on tests in major fields 
(nursing, education, etc.); and 

Assessment of program graduates based on ex- 
ternal measures (placement, national perfor- 
mance awards, GRE scores, etc.) 

Tennessee: Tennessee's Performance Based Funding 
Program - the most ambitious of its kind in the na- 
tion - was established in 1978 enhance the overall 
quality of the state's public system of higher educa- 
tion. The program incorporates the following out- 
comes crite 1 ^ '. in making awards of up to 5 percent of 
each institutions' base budget for the previous year: 

1. The percentage of programs eligible for accredita- 
tion that are accredited; 

2. The percentage of programs that have undergone 
peer review; 

3. The percentage of programs that administer a 
comprehensive examination to their majors; 

4. The value added by the general education com- 
ponent of the curriculum, as demonstrated by stu- 
dents' scores on the College Outcomes Measures 
Project examination of the American College 
Testing Program; 

5. Demonstration that specific improvement in cam- 
pus programs and services have been stemmed 
from evidence about the quality of academic pro- 
grams or services derived from surveys of enrolled 
students, alumni, community members, and em- 
ployers; and, 

6. The implementation of a campus-wide plan for in- 
structional improvement based on findings de- 
rived from the above procedures. 
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Competitive grant programs 

California: Each of California's three segments of 
public higher education operates at least one com- 
petitive grant program: 

• The Instructional Improvement Fund of the Uni- 
versity of California was originally established in 
1971 to support innovative initiatives that will en- 
hance the effectiveness of undergraduate instruc- 
tion at the University's nine campuses. Among 
the activities supported through the Fund are the 
sponsorship of speakers on instructional improve- 
ment topics, the development of new courses and 
programs, and improved training of teaching as- 
sistants. The Fund is designed to provide each 
campus the autonomy to decide which areas of un- 
dergraduate education have the highest priority. 

• The Academic Program Improvement Fund (API) 
of the California State University was established 
in 1972-73 to introduce a variety of new ap- 
proaches to instruction, assessment, academic ad- 
vising, program design, instructional support ser- 
vices, faculty development, instructional technol- 
ogy, and academic policy and planning. Changes 
initiated and implemented on a State University 
campus through API funding are designed to facili- 
tate adaptation of model solutions by other cam- 
puses in the State Univ~~sity at reduced cost and 
to permit their continuance with regular institu- 
tional resources after external support has been 
discontinued. 

• The Fund for Instructional Improvement of the 
California Community Colleges was established 
in 1977 to support alternative educational pro- 
grams and services in the State's community col- 
leges, including: (1) individualized instructional 
programs; (2) orograms for improving faculty 
members' teaching effectiveness; (3) Summer 
"bridge" programs for the transition period into 
collegiate education; and (4) intersegmental sum- 
mer programs including research projects and 
seminars. 

Colorado: Colorado's Program for the Promotion 
and Encouragement of Excellence was established 
by the Legislature in 1985 to support activities with 
the highest potential for improving public higher 
education in Colorado, which include efforts to im- 
prove students' writing and critical thinking skills 
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and to enhance faculty members' effectiveness in 
conducting computer-assisted instruction. 

Connecticut: Connecticut's Centers of Excellence 
Program was established by the Legislature in 1984 
to encourage public institutions to enhance or devel- 
op distinctive instructional, research, or public ser- 
vice programs which have gained, or have the poten- 
tial to gain, regional or national prominence. Pro- 
gram resources have al c o aimed at: (1) providing 
funds for libraries or equipment so as to enhance ex- 
isting programs with potential for excellence; and (2) 
encouraging institutional mission differentiation by 
concentrating existing resources and builHing on 
areas of institutional strength. 

Kentucky: Kentucky's Centers of Excellence Pro- 
gram was established by the Legislature in 1985 to 
enhance the distinctive strengths of the state's high- 
er education institutions, consistent with their mis- 
sion, by supporting centers which have the likeli- 
hood of acquiring regional or national prominence. 
For example, the "Center for Collaborative Advance- 
ment of the Teaching Profession" at the University 
of Louisville's School of Education, serves to design 
and implement new programs for teacher prepara- 
tion and continuing professional development for 
teachers and faculty. 

Michigan: Michigan's Select Student Support Ser- 
vices ("4-S") Program was established by the Legis- 
lature in 1987 to increase the number of academ- 
ically and economically disadvantaged students who 
enroll and succeed in the state's public and inde- 
pendent colleges and universities. For the next year, 
the Program's focus will shift from student access 
plus retention to strictly retention, based on the view 
that improved retention rates will attract other stu- 
dents to the institutions as a natural occurrence. 

New Hampshire: New Hampshire's Innovation and 
Opportunity Grants Program was established in 
1988 to provide incentives to professors and institu- 
tions of the University System of New Hampshire to 
increase educational opportunity and to improve 
programmatic and institutional choice for the resi- 
dents of New Hampshire. Funding is provided in 
three categories: (1) "program articulation" to im- 
prove, for example, the student flow among pro- 
grams and institutions through agreements for 



credit transfer and the sequencing of curricula; (f v 
"coordination of services" to bring program and 
other institutional services that contribute to a com- 
mon purpose; and (3) "increases in resident enroll- 
ment 19 through, for example, bringing high school 
students into campus/course activities. 

New Jersey: New Jersey's Competitive Grants Pro- 
gram was established in 1984 to encourage instruc- 
tional innovation and to provide an institutional 
basis for making resource allocation decisions. 
Among the subgroups of competitive grant programs 
funded are: (1) the "Technical and Engineering 
Grant Program 19 designed to improve, expand or es- 
tablish technical and/or engineering programs; (2) 
the "Computers in Curricula Grant Program" de- 
signed to foster the integration of computers into 
academic programs; (3) the "Math, Science and Com- 
puter Teaching Improvement Grant Program 99 de- 
signed to support non-credit summer training insti- 
tutes for K-12 teachers of mathematics, sciences, or 
computers; and (4) the "Fund for the Improvement of 
Collegiate Education 99 designed to encourage im- 
proved student access and academic performance, to 
improve teaching and the student learning environ- 
ment, and to improve student retention and gradua- 
tion rates. 

Rhode Island: Rhode Island's Incentive Fund for 
Excellence was established in 1987 to promote ex- 
cellence in Rhode Island's three public institutions 
of higher education by supporting activities de- 
signed to strengthen undergraduate education that 
otherwise could not be undertaken or normally sup- 
ported by the institutions. Examples of the projects 
funded are: (1) the "MATH-TUTOR: An Intelligent 
Computer-Aided Instructional Program" that en- 
gages students in an instructional dialogue with a 
computer program system that poses problems in 
mathematics, analyzes student errors, makes sug- 
gestions, instructs, and tracks students' progress; 
and (2) the "Improving Writing and Thinking 
Through Linked Courses Program" - a pilot pro- 
gram in which a General Sociology course and a 
Composition course are linked so that content-cen- 
tered material from the sociology course and skills- 
centered material from the composition course can 
simultaneously improve students' ability to write 
and think in academic content areas. 



ERIC 2 



Virginia: Virginia operates three competitive grant 
programs of note: 

• Its Funds for Excellence Program was established 
in 1980 to support activities with potential for ex- 
cellence in the areas of undergraduate teaching 
and curriculum development in the liberal arts 
and sciences at Virginia's public colleges and uni- 
versities. Projects funded by this Program fall into 
the following categories: (1) skills across the cur- 
riculum; (2) faculty and curricular development; 
(3) academic advising; (4) the integration of race 
and gender issues into the curriculum; (5) educa- 
ting a diverse student population; (6) internation- 
al education; and (7) engineering. 

• Its Funds for Excellence Subprogram was estab- 
lished in 1983 to support innovative programs for 
the recruitment and retention of minority stu- 
dents through competitive grants at the institu- 
tions. 

• Virginia's Academic Centers of Excellence-Com- 
monwealth Centers Program was established in 
1988 to recognize and promote existing disciplines 
or areas of excellence in the state's universities. 
The Centers funded are those regarded by peers as 
among the best in the nation or world and which 
possess the essential attribute of "knowledge"- its 
discovery, development and application, and its 
transfer to students and others for enlightenment, 
further analysis, refinement, and utilization. 

Challenge grant programs 

Florida: Florida operates two challenge grant pro- 
grams: 

• Its Enhancing Undergraduate Education Program 
was established in 1983 to improve the State Uni- 
versity System's performance in areas such as: (1) 
the diversification and differentiation of institu- 
tional mission; (2) State University and secondary 
school relationships; (3) academic and non-aca- 
demic support services for non-traditional stu- 
dents; (4) student involvement in the classroom, 
extracurricular activities, and in public and com- 
munity service; and (5) the assessment of students' 
undergraduate experience. 

• The Florida Academic Improvement Trust Fund 
was created in 1983 to enable each community 
college in the state to establish a depository for 
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private contributions and matching state funds, 
which can be used to support efforts such as: (1) 
the purchase of scientific and technical equip- 
ment; (2) professional development and training 
for faculty; (3) activities appropriate to improving 
the quality of education at the community col- 
leges; and (4) student scholarships. 

New Jersey: New Jersey established its Challenge 
Grant Program in 1985 to promote improvement 
across all the state's institutions of h! 6 ner educa- 
tion. For example, challenge grants have been given 
for (1) the Kean College project, designed to imple- 
ment a "value added" assessment model and to in- 
fuse the use of computers over all fields of study; (2) 
the "Excellence Initiative" of Rutgers University, 
which is research oriented and is designed to, for ex- 
ample, recruit and develop outstanding junior facul- 
ty through release time for research and the en- 
hancement of technical support; (3) the New Jersey 
Institute of Technology efforts to, for example, devel- 
op computing based curricula in both engineering 
and architecture; and (4) the two-year institutions to 
focus their excellence efforts on minority recruit- 
ment and retention, linkages to secondary schools, 
and the development and enhancement of technical 
programs. 

Ohio: Like Florida, Ohio operates two challenge 
grant programs: 

• Its Academic Challenge Program was established 
in 1985 to provide funds for Centers of Excellence 
at Ohio's colleges and universities to strengthen 
further their best programs. As a means to induce 
the institutions to target a few of their best pro- 
grams, each program must receive Academic 
Challenge monies equivalent to a minimum of 10 
percent of its total budget. As an example of pro- 
gram efforts, Academic Challenge monies to 
Youngstown State University's Department of En- 
glish, which is recognized as a national leader in 
working with schools to improve writing skills, 
have served to provide opportunities for students 
to obtain practical writing skills through "real- 
world* 9 communication projects that use micro- 
computers and internships with area newspapers, 
business, and other organizations. 

• The Productivity Improvement Challenge Pro- 
gram was established in 1985 to support (1) job 



training programs essential to Ohio's economy, 
ar> \Z) progranr that expand access, especially for 
minority students, by encouraging all students to 
pursue a degree beyond high school. 

Virginia: Virginia created its Student Assessment 
Program in 1987 to fund the implementation of ac- 
ceptable "comprehensive student assessment plans" 
at each public institution of higher education in 
Virginia, based on methods most appropriate to each 
institution's unique character and mission. Al- 
though funding for these plans will begin in 1988-90, 
in the 1986-88 budget, James Madison University 
received a special appropriation of $90,000 to devel- 
op a pilot program in student assessment. 



Administration and funding 
of programs in other states 

For the most part, the administration of incentive 
funding programs rests with the states' central 
board for coordinating or governing their higher 
education institutions. Yet, decisions about which 
proposals to fund and the funding criteria to use are 
usually made with the assistance of a committee or 
panel comprised of institutional representatives plus 
staff of the state coordinating/governing board, and, 
in some instances, with out-of-state consultants or 
experts in the field. Programs targeting one system 
of institutions in a state (such as their research uni- 
versities), are usually administered by that system's 
governing board - as is the case with the segment- 
based competitive-grants programs in California. 

The combined funding of California's three competi- 
tive grants programs comprises less than one-tenth 
of 1 percent of its budget for higher education - the 
lowest percentage in the 12 states reviewed in this 
study. As a percentage of each states' total appropri- 
ations to higher education, funding for the incentive 
funding programs in the other 11 states comprises a 
low of 0.13 percent in Michigan and a high of approx- 
imately 4.7 percent in Florida, with the majority of 
the states falling in the range of 1.0 percent to 2.3 
percent. It should be noted, however, that states 
such as Michigan supported only one incentive fund- 
ing program, whereas states such as Florida and Vir- 
ginia each supported up to six separate programs. 



13 



Current and potential 
incentive funding in California 

As noted above, the three current incentive funding 
programs in California are the Academic Program 
Improvement Fund of the California State Univer- 
sity, the Instructional Improvement Fund of the 
University of California, and the Fund for Instruc- 
tional Improvement of the California Community 
Colleges. These programs operate on a competitive 
basis and are designed primarily to support "pilot" 
instructional improvement initiatives that, perhaps, 
could be subsequently implemented on a broader 
scale. \t the California State University and the 
California Community Colleges, only selected cam- 
puses and programs actually receive funding each 
year. 

Should additional incentive funding programs be es- 
tablished in California, it might serve the State best 
for these to be administered by the segments, owing 
largely to the State's political and demographic com- 
plexity as well as its large and heterogeneous higher 
education enterprise. Moreover, the segments al- 
ready have the experience with administering the 
State's current competitive-grants programs. Yet, 
the appropriate responsibility for evaluating the ef- 
fectiveness of new incentive funding programs and 
r or recommending the changes needed to ensure 
their success should rest with the California Postsec- 
ondary Education Commission. 

In sum, certain aspects of the performance based 
funding and competitive grant approaches appear to 
limit their likely success in achieving broad student 
and faculty diversity in California higher education. 
The competitive grants approach is generally de- 
signed to provide only selected institutions with ' 
funding for educational improvements or experi- 
mentation. Also, in certain situations these ap- 
proaches could lead to a fragmented priority-setting 



process wherein departmental or institutional pa- 
rochialism would prevail at the expense of obtaining 
an integrated institution- or state-wide commitment 
to targeted priorities. Perhaps this would occur in 
California if a State-wide competitive-grants pro- 
gram is established, owing largely to 'ie State's 
political and demographic complexity as well as its 
large and heterogeneous higher education enter- 
prise. Further, in the truly open competitive-grants 
process, funding is often based on the quality of the 
proposals actually developed - wherein institutions 
with the most resources will likely prepare the best 
proposals and therefore claim the lion's share - 
rather than on the merits of the activities or desired 
results that should actually be funded. 

The "performance based" funding approaches, on the 
other hand, not only requires the development of re- 
liable criteria for justifying funding decisions - 
which is a challenging task as the ongoing assess- 
ment debate has made evident - but they also could 
have the ironic and often unintended consequence of 
denying improvement monies to those programs and 
institutions that have demonstrated the greatest 
need to improve. 

In short, of the three major incentive funding 
approaches at work for promoting quality in higher 
education, the "challenge grants" approach appears 
the most promising for supporting initiatives to im- 
prove teaching and learning and to promote greater 
student and faculty diversity in California higher 
education. This view is premised on the known 
merits of the challenge grants concept, namely, that 
these grants can be awarded to institutions on an 
"entitlement" basis - if they meet preestablished cri- 
teria or if they develop approvable institutional 
plans for implementing program initiatives - and 
often with a multiple-year funding commitment 
from the State, contingent on the demonstrable 
achievement of program objectives. 
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Approaches to Talent Development 
4 and Value-Added Assessment 



IN this section of f he report, the Commission seeks 
to clarify the concepts and, as necessary, to redefine 
the terms of talent development and value-added 
assessment, in the interest not only of demystifying 
them but, most importantly, of considering how they 
relate to quality improvement in California higher 
education. As Fn;nk Young of the California State 
University and a uember of the Commission's ad- 
visory committee for this study has noted, these 
terms have often been defined in ways that are gen- 
erally counterproductive to discussions of assess- 
ment: 

Through their powerful historical associations 
and attractiveness of the concepts themselves 
as they relate to formal education, and through 
their most recent identification with specific 
and controversial institutional assessment pro- 
grams, the terms value-added and talent devel- 
opment have acquired a degree of ambiguity 
that obfuscates rather than facilitates con- 
structive discussion of assessment issues. 

Most observers would agree that in the current dis- 
cussions of assessment in American higher educa- 
tion, the terms talent development and value-added 
have been considered synonymous and used inter- 
changeably. In addition, it is evident that consider- 
able disagreement and ambivalence exists as to 
what the terms imply and how they might best be 
conceptualized in relation to the unique needs, 
goals, and circumstances of an individual institution 
or state. 



Talent development 

The term talent development can be most meaning- 
fully conceptualized as the educational goal of facili- 
tating or contributing to students' optimal learning 
and growth, consistent with an institution's mission 
and the student clientele it serves. 



In this sense, California's universities and commu- 
nity colleges provide a wide diversity of contribu- 
tions to "talent development" in the form of reading 
and writing skills, technical/vocational skills, 
breadth of knowledge in general education and a ma- 
jor discipline, critical thinking skills, a sense of civic 
responsibility, and so forth. The community col- 
leges' contributions to the goal of "talent develop- 
ment" are perhaps the most diverse: the provision of 
remedial and/or refresher courses plus short-term 
technical/vocational training programs as well as 
the provision of traditional lower-division collegiate 
education in their transfer programs. 

In short, all contributions made by colleges and uni- 
versities to students' learning and growth across a 
wide range of desired cognitive and affective attri- 
butes - including acquisition of specialized vocation- 
al skills, such as in computer programming, that are 
often sought by "reverse transfer" students - can be 
legitimately viewed as contributions to "talent de- 
velopment." 



Value-added assessment 

"Value-added" assessment has come to be most 
commonly perceived as a pre- and post-testing proc- 
ess for measuring changes or gains in students' 
knowledge, attitudes and skills between the begin- 
ning and the end of their college experience. Value- 
added programs in place today, such as those at 
Northeast Missouri State University, the University 
of Tennessee in Knoxville, and of institutions partic- 
ipating in the FlPSE-funded Value Added Consor- 
tium, utilize a variety of instruments to measure 
th»«e changes, including standardized tests, perfor- 
mance samples, essays, locally developed exams, in- 
terviews, and surveys. Other key components of the 
value-added assessment programs in these institu- 
tions are major field examinations for graduating 
students, and attitude surveys of current students 
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and alumni, conducted longitudinally. In addition, 
value-added assessments are often conducted on 
multiple levels. At Northeast Missouri and the Uni- 
versity of Tennessee in Knoxville, for example, the 
assessment of student gains in general education be- 
tween the freshman and the junior and senior years 
is conducted at the campus level - utilizing the ACT* 
COMP (College Outcomes Measure Project) instru- 
ment - yet each department undertakes its own, de- 
partment-specific assessment process. 

Although the value-added assessment method is a 
topic of considerable discussion today, its implemen- 
tation has, to date, been on a relatively small scale. 
In addition, the method has been criticized by some 
as possessing major limitations, which include the 
following: 

• Because value-added assessment requires a care- 
ful and accurate measurement of /arious student 
attributes at entry to the institution and on 
through graduation, it is a considerably time-con- 
suming and expensive process that can expend 
some of the valuable resources that are needed for 
maintaining an effective instructional program. 

• Value-added gains are difficult to link directly to 
the institution's instructional processes and over- 
all environment because of the difficulty of isolat- 
ing the influence of noninstitutional factors on 
student development, such as student maturation, 
public participation, family life, and personal cir- 
cumstances. 

• Because different students will achieve at differ- 
ent levels even when controlling for the curricu- 
lum and instructional processes, it is difficult to 
ascertain what student growth or Value-added" is 
attributable to the curriculum and the instruc- 
tional processes. 

• Value-added assessments discount the importance 
of bottom-line or "minimum" competency stan- 
dards of student achievement since it places pri- 
mary emphasis on gains or improvement as the 
primary criteria of excellence. The argument is 
that the process diminishes the importance of re- 
quiring a threshold of standards - certain skills 
and knowledge - that all college graduates should 
possess. 

In responding to the above criticisms, proponents of 
value-added assessment concede that an effective 
value-added assessment program will require a con- 



siderable commitment of resources to establish, and 
that the challenges of obtaining valid measures and 
comparisons of student gains over time - which can 
then be linked directly to the relative contributions 
of the educational process - are indeed real. For this 
reason, they hasten to note that value-added infor- 
mation is most useful when it is obtained: (1) as part 
of a more holistic evaluation process than it can be 
through pre- and post-testing testing alone, looking 
at a variety of student characteristics and noninsti- 
tutional factors that might influence student per- 
formance; and (2) to compare the effectiveness of a 
course, program, or institution over time, examin- 
ing, for example, aggregated data on student gains 
that might account for the relative shifts in the 
levels of student performance as well as the chang- 
ing contributions of the content and delivery of the 
instructional process. An example of such an ap- 
proach to value-added assessment is proposed by 
Marcia J. Belcher (1987, pp. 34-35): 

If standardized tests and placement tests are 
used and if improvement in writing and math 
skills is the issue (as it is in many community 
colleges), then a second and perhaps supple- 
mental process might be employed to assess the 
value added. I propose a four-step process 
whereby the institution would administer an 
entry-level test in basic skills and use the re- 
sulting scores to place students in their initial 
level of coursework; decide which curricular 
variables should be related to the level of basic 
skills measured at the point when the student 
graduates and collect information on these 
skills for each student; select a test of basic 
skills to be given at the point of graduation (it 
can be the test used at entry, or it can be a more 
difficult test on the same content area); and 
conduct a yearly analysis (using a statistical 
technique, such as multiple regression) to 
assess the extent to which the entering level of 
basic skills and the curricular variables predict 
the exit level of basic skills. 

Such a process could answer the question about 
the relative contributions of entering skills and 
the curriculum. Because the analysis would 
account for the possibility of shifting levels of 
basic skills, the changing contributions of the 
curriculum across the years could be assessed. 

Proponents of value-added assessment note that the 
criticisms of the approach stem in large measure 



from major misconceptions of the possible and appro- 
priate applications of the value-added method and 
the many possible, constructive uses of value-added 
information. These misconceptions, they argue, re- 
sult in the tendency to define it in a limited way: as 
applying only to nationally standardized testing. 
For example, according to Alexander Astin, the first 
major proponent of value-added assessment in high 
er education, a common misconception about the 
value-added approach is that it somehow reduces 
academic standards, whsn, in fact, the approach is 
neutral with regard to outcome levels of achieve- 
ment that should be expected of students'. Agreeing 
that competency standards are important and 
should not be compromised, Astin and other major 
proponents of value-added assessment stress that its 
particular value is in guiding: (1) the student place- 
ment and remediation process by facilitating the 
task of matching the curriculum and various in- 
structional alternatives to students needs and goals; 
and (2) the ongoing teaching-learning process by in- 
forming individual students and faculty about what 
they can or must do to attain the expected or desired 
levels of achievement. 

The appeal of the value-added assessment approach 
stems from the emphasis it places on measuring stu- 
dent change and development over time as a neces- 
sary tool for guiding the teaching and learning proc- 
ess. Such assessment efforts enable institutions to 
better understand their actual contribution to stu- 
dent learning. According to Turnbull (1987), "the 
root idea of assessing how much students learn or 
improve or grow in school or in college, as well as 
how they stand at graduation, is not only a good and 
important idea but obviously one that lies near the 
heart of the educational experience" (p. 3). 

Although the value-added approach is often associ- 
ated only with the assessment of student growth, it 
could also involve measurement of the growth or de- 
velopment of the individual faculty members and of 
the institution since, presumably, the most value- 
added occurs when the teaching-learning process is 
dynamic as well as student and faculty centered, and 
when the faculty and institution are involved in a 
systematic and ongoing process of self-etudy and 
self-renewal. As Alexander Astin has noted, for ex- 
ample, the value-added view of excellence is one that 
focuses on the educational impact of institutions on 
their students and faculty members, with those in- 
stitutions considered the most excellent that "add 
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the most value" during the educational process to 
these individuals, regardless of their initial skills or 
knowledge (1985, p. 1). 

Several issues related to value-added assessment are 
becoming increasingly significant. First, as an 
"idea" it appears to be gaining some momentum 
across the nation, albeit slowly, as evidenced by the 
growing number of individual institutions that have 
implemented value-added initiatives or are consider- 
ing doing so. At the state level, value-added assess- 
ments are already required in Tennessee and South 
Dakota, while states such as California, Colorado, 
Maryland, New Jersey, and Virginia are either seri- 
ously leaning toward its implementation or, as is the 
case with California, are under a legislative man- 
date to evaluate the advantages and disadvantages 
associated with its adoption. Second, because value- 
added assessments can serve to measure a variety of 
student and institutional outcomes, through the use 
of multiple procedures or approaches that are devel- 
oped with the full involvement of students and fac- 
ulty, it can and should be tailored to suit the partic- 
ular needs and circumstances of each institution and 
state. Related to this point, Marcia Belcher arrived 
at the following conclusion about value-added 
assessment: 

If value-added assessment is implemented with- 
out regard to the information needs of adminis- 
trators, faculty, and students or to the unique 
character of the institution, it will probably fail. 
If it is implemented thoughtfully with the full 
participation of all interested parties and with 
multiple measures and approaches, it may suc- 
ceed in providing focus to the real goal of higher 
education - teaching and learning - and in 
bringing lasting and beneficial change to higher 
education (1987, pp. 36-37). 

In summary, on the one hand, it appears that appro- 
priate value- added assessments can: (1) assist an in- 
stitution to better understand the student changes 
and growth that are attributable to education -re- 
lated experiences; and (2) serve as a stimulus for pro- 
gram change and curricular improvements by dem- 
onstrating where performance falls short of expecta- 
tions. Further, the substantial appeal of the value- 
added assessment approach is the attention that it 
focuses on the teaching-learning process for the pri- 
mary purpose of improving it - a key element of the 
approach that can be embraced in the hierarchy from 



classroom to Legislature. Moreover, some evidence 
suggests that the pre- and post-test procedures of 
value-added approaches may prove useful in identi- 
fying such competencies as wnting, knowledge of 
the subject, analytical reasoning, rund critical think- 
ing. And although value-added approaches may be 
inappropriate or too problematic to operationalize in 
some educational contexts, as educational processes 
they serve the valuable and legitimate purpose of in- 
ducing educators and institutions to think of the 
teaching-learning process in developmental terms. 

On the other hand, the value-added assessment pro- 
grams that have been implemented to date and that 
are looked upon as models for possible evaluation by 
other institutions remain controversial, owing 
largely to their limitations in recognizing and ac- 
counting for key variables which influence student 
performance, such as students' maturation rates, 
general intellectual development, prior experience, 
and reasons for enrolling in the course or program. 
Also, some questions of method and measurement, 
such as the practical difficulties of establishing reli- 
able baseline data and control group information, re- 
main unresolved issues. Where these difficulties 
exist, complex statistical analysis and costly experi- 
mental methods are often necessary to determine 
value-added gains. Moreover, additional research 
appears needed to determine which multiple assess- 
ment methods are best suited for each discipline, es- 
pecially those that are not necessarily cumulative or 
synthetic. For example, the study of History does 
not require a strict sequence of prerequisites to en- 
able students to acquire an understanding of the dis- 
cipline and knowledge of the field. For several rea- 
sons, then, the value-added approach must be rigor- 
ously examined and carefully weighed by faculty of 
any campus considering its adoption as a component 
of a student outcomes assessment plan. (More about 
assessment in general at the national level and in 
California can be found in Appendix C.) 



Principles of institutional assessment 

The Commission's advisory committee for this study 
discussed at length issues of desira ,le practice in in- 
stitutional assessment, and the fo lowing ten state- 
ments summarize their conclusions: 
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1. The primary purpose of assessing student out- 
comes is to guide and improve the teaching- 
learning and academic advising processes at the 
individual, course, program, and/or institutional 
level, which, in turn, should facilitate students' 
learning and development as the basis for en- 
abling them to achieve literacy, to think critical- 
ly and abstractly, to adopt to changing environ- 
ments, and to develop the capacity for further 
learning and growth. 

2. The wide diversity of educational settings found 
in California requires that efforts to assess stu- 
dent learning and development are premised on 
the recognition that multiple definitions of edu- 
cational excellence are both plausible and legiti- 
mate, owing to the State's large and diverse 
higher education enterprise. Thus, the ap- 
proaches and methods adopted to assess student 
learning and development should be expected to 
assume several forms and be developed through 
a sufficiently decentralized process to reflect the 
multiplicity of missions, functions, and needs of 
the State's different segments, institutions, and 
programs of education. 

3. Assessment methods and programs to assess stu- 
dent outcomes should be campus based, respon- 
sive to student needs, and developed as tools or 
means for improving the teaching-learning proc- 
ess, rather than as ends in themselves. More- 
over, these should rely primarily on the faculty 
for decisions regarding: how assessment should 
be conducted; the design or selection and admin- 
istration of assessment methods; the interpreta- 
tion of the results; and how the data will be used 
to improve programs. 

4. The development, implementation and refine- 
ment of effective assessment methods and pro- 
grams is an evolutionary process that requires 
time and experimentation as well as campus- 
wide and segment-wide discussions and work- 
able agreements about the concepts and appro- 
priate purposes of assessment. 

5. Consistent with the principle of institutional re- 
sponsibility, State resources appropriated for 
assessment should support the development and 
operation of programs at the campus level. Yet, 
State support for these efforts should be expected 
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to facilitate the institutions' ability to demon- 
strate their effectiveness (accountability) to 
State leaders and a variety of other external con- 
stituencies. 

6. Meaningful outcomes assessment must be multi- 
variate if it is to provide valid information for 
use In improving teaching and learning. Stan- 
dardized tests, when used alone, provide specific 
but limited kinds of information, and do not give 
an adequate picture of some of the most impor- 
tant outcome? of education. 

7. Student characteristics and academic program 
variables that affect student learning need to be 
systematically considered as part of an assess- 
ment program. Thus, any assessment program 
must take into account changes in students' 
lives and development, both during and after 

.their formal educational experience. Where 
' these variables can be monitored using system- 



wide databases, applicable data should be pro- 
vided to the academic departments. 

8. A full assessment program will take into consid- 
eration such factors as: academic advising, coun- 
seling and career planning, the quantity and 
quality of student-faculty interaction, laborator- 
ies, libraries, housing, financial aid services, ex- 
tracurricular activities, health services, and 
campus social life. 

9. Appropriate assessment is but one characteristic 
of an effective institution. A number of other in- 
stitutional activities and practices are essential 
that not only complement the assessment func- 
tion but that, in toto, must exist in order to 
achieve institutional excellence. 

10. Data collected through institutional assessment 
programs should be governed by recognized 
codes of ethics treating research with human 
subjects. 



19 



Priorities for State Incentive Funding 
5 in California Higher Education 



A SUBTLE but important development emerging 
from the national debate about quality assessment 
in higher education is the expanding view of educa- 
tional "excellence" or "quality" - how best to define 
it, measure it, and attain it. This expansion pro- 
vides the basis for the Commission's recommenda- 
tions about future State incentive funding for Cali- 
fornia's colleges end universities, and in this final 
section of the report, the Commission discusses its 
implications before turning to its proposals for in- 
centive funding. 



The expanding views of "excellence" 
and "quality" in higher education 

California's recent Commission for the Review of the 
Master Plan for Higher Education and its Legisla- 
ture's Joint Committee for Review of the Master 
Plan have sparked a continuing dialogue about ways 
to prepare the State's higher education enterprise 
for the challenges it will face over che next two de- 
cades. A major focus of this dialogue has centered on 
the educational needs of California's rapidly chang- 
ing student population. Two examples serve to illus- 
trate this focus. 

• Underlying the discussion about needed impiove- 
ments in curriculum, teaching, articulation, and 
remediation has been a concern for promoting stu- 
dent success and increasing student performance. 
State policy makers and educators have increas- 
ingly come to view student success or failure as a 
function not only of student ability, preparation, 
and effort but also of institutional characteristics 
such as the quality of courses, the effectiveness of 
pedagogy, and the character of the overall campus 
environment. In this view, students' success is 
affected by their experience > 'ith a rich and chal- 
lenging curriculum, effective teachers, and ade- 
quate student support services. This view holds 
that students should not shoulder the entire "bur- 



den of proof about their success but that faculty 
members, administrators, and support staff are al- 
so partially accountable for student performance. 
From this perspective, an institution's student re- 
tention, transfer, and graduation rates can be 
looked to as important and legitimate indicators of 
its educational effectiveness or excellence, as long 
as the characteristics of incoming students is tak- 
en into account. 

• Second, the issue of achieving greater student and 
faculty diversity in California's institutions of high- 
er learning as well as greater multicultural and 
international awareness across the curriculum 
has emerged as a priority concern at both State 
and campus levels and has led to viewing quality 
and diversity as interdependent State goals for 
higher education. From this perspective, educa- 
tional institutions must familiarize students with 
the socioeconomic and cultural character of the 
larger society in which they live - and must edu- 
cate broadly among the diverse groups comprising 
that society if they are to provide quality edu- 
cational experiences for their students. 

The implications of this expanding view of educa- 
tional excellence for California are evident in the fol- 
lowing statement of Leigh Mintz, associate vice pres- 
ident of California State University, Hayward, and a 
member of the advisory committee for this study: 

In the '80s, access has come to mean more than 
simply entry, but support services and people to 
assist students through a meaningful educa- 
tional process to graduation. As a result, we in 
education must pay considerably more atten- 
tion to helping students improve their skills and 
knowledge so they can succeed. This means we 
must assess them when they enter to determine 
if and what level of deficiencies they may have, 
place them in the proper remedial courses when 
necessary, work with them in meaningful aca- 
demic programs, and determine at the end that 
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our efforts have indeed made a difference. If we 
cannot show we have made a difference in the 
intellectual life of students and provided them 
with the skills necessary to survive in our 
economic system, we may have difficulty in ask- 
ing for higher levels of public support. Hence, I 
believe the correct type of assessment, geared to 
improved teaching and learning, is a corner- 
stone of improved access and an issue we should 
strongly support. 



Initiatives to achieve broad 
student access and success 

Initiatives to achieve the State's priorities for broad 
student access and success involve institutional ef- 
forts to (1) articulate clearly what their educational 
goals are - what student performance outcomes they 
most intend to ach ve; (2) judge how students' per- 
formance is influenced by such factors as the cur- 
riculum, the pedagogical process, and the configura- 
tion and content of the overall institutional environ 
ment; and (3) provide effective instruction, a mean- 
ingful curriculum, and other institutional services 
that will improve student achievement. In short, 
the State should encourage several quality initia- 
tives, including assessment, that enable institutions 
to know how well they are serving each of their stu- 
dents and, on an ongoing basis, to improve their 
capacity to respond effectively to their students' edu- 
cational needs and interests. 

Initiatives related to effective pedagogy 

A major institutional initiative to improve student 
achievement involves the development of and/or ex- 
perimentation with effective pedagogical methods - 
such as those involving computer assisted instruc- 
tion and "collaborative" or "team effort" learning - 
that will respond best to different student abilities 
and modes of learning. An initial role for the State 
in this area could be to foster intersex nental efforts 
of collecting and disseminating broadly information 
on effective pedagogical approaches being developed 
and implemented successfully in programs and in- 
stitutions in California and other states. These 
efforts, in turn, might be appropriately supported 
through an intersegmental center (or institute) on 
effective pedagogy that is based in and managed by 

ERJC 2 



one of the State's public universities. In this regard, 
the California State University is already develop- 
ing plans for a "Teaching and Learning Institute," 
wherein faculty systemwide can pursue research 
topics related to instruction. 

The value of such a center to improving teaching and 
learning is evident. It could provide individual fac- 
ulty members from all the segments with valuable 
recognition for their contributions to the area. Most 
importantly, it could also provide faculty members 
an enhanced understanding of pedagogical ap- 
proaches that respond effectively to different student 
abilities and styles of learning reflected in Califor- 
nia's increasingly diverse student population. New 
approaches to computer-assisted instruction, for 
example, appear particularly promising to the needs 
of California's rapidly changing student population 
and its transition from an industrial to an informa- 
tion economy. In addition to the appropriate use of 
the computer as an important requirement for many 
professions of the future, the computer as an educa- 
tional tool is rapidly becoming inexpensive and edu- 
cationally self-sufficient. 

The statewide center envisioned herein would serve 
to improve pedagogy largely insofar as it offers ser- 
vices that are both wanted by faculty and do not du- 
plicate what they can obtain on their own campuses 
or through their own professional organizations and 
networks. In addition, this center would need to be 
engaged in active dissemination (conferences, con- 
sulting materials, etc.) in order to be effective. 

Initiative related to institutional assessment 

Another important initiative to improve student 
achievement in California involves the development 
of institutional assessment plans that are designed 

to: 

1. Chart or track student change and growth over 
time along a continuum of expected dimensions of 
student learning and development, which would 
include but not be limited to breadth of knowl- 
edge in general education and in the major/spe- 
cialized discipline; intellectual skills and habits; 
humane and ethical values; social responsibility; 
and career preparation. 

2. Link student learning and development to the 
teaching-learning process and other major ele- 
ments of the institutional environment, which 
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would include but not be limited to. the quality 
and quantity of student-fsculty interaction; the 
range and depth of the curriculum; the quality of 
student support services (i.e., student financial 
aid, housing, libraries, tutorial services, child 
care opportunities, etc.), and the effectiveness of 
the teaching and student-advising processes. 

3. Assist the faculty and administrative leadership 
of the institution to make the possible and neces- 
sary changes in the content and delivery of the 
instructional processes that would most contrib- 
ute to student success - consistent with the edu- 
cational goals of the students, the faculty, the in- 
stitution, and the State. 

The institutional assessment plans should be devel- 
oped locally, tailored to suit the particular needs of 
each institution, and aimed at guiding and improv- 
ing the teaching-learning process. In addition, the 
creation and implementation of these plans should 
be guided by principles demonstrated to be consis- 
tent with effective institutional improvement mod- 
els, such as those listed at the end of Part Four. 

Appropriate interinstitutional and intersegmental 
collaboration in the development of institutional 
assessment plans could prove beneficial in enhanc- 
ing each institution's understanding of the multi- 
plicity of existing and new assessment purposes, pro- 
grams and practices that could serve it best. The 
State's fiscal realities, however, dictate that funding 
for the institutional assessment plans must be a 
shared responsibility between the institutions and 
the State, and that State support for these plans 
must be phased-in gradually, building on what is 
learned about the effectiveness of those already in 
place. 

A statewide student information system 

Underscored in the initiatives to improve student 
achievement described above is the need for better 
longitudinal information on individual college stu- 
dents. Thus, the development of a comprehensive 
statewide student information system is a major 
quality initiative facing California. 

This system is needed to track individual students 
from entry point through the educational program to 
the exit point and beyond. Information is needed on 
each stare of the students' collegiate career, which is 



essential to the evaluation and planning processes at 
the campus and segmental levels. Although so.ao of 
the student information collected by institutions 
should be institution specific, there is considerable 
need for information common to all institutions. 
Most important, this information is necessary for 
better understanding the factors that influence stu- 
dent access and ietention and for assessing the im- 
pact of program changes and innovations on student 
performance. 

Three categories of data should, at a minimum, be 
incorporated into the student information system: 

• The first would be entry data, such as application 
and admissions information, demographics, and 
information about the student aspirations and 
plans. Where appropriate, these would include 
placement test results or "pre-tests" for subse- 
quent assessments of student development over 
time. 

• The second category would be process data that 
would document any experiences the student has 
had that could affect his or her progress. Ex- 
amples of these data are: the courses taken oy the 
student, the program or school the student en- 
rolled in, students' participation in special pro- 
grams such as remedial or honors, and informa- 
tion concerning place of residence, financial aid, 
and extracurricular participation - factors that 
have been shown to affect student retention and 
development. 

• The third category would be exit or outcome data, 
such as the student's status at exit, such as pro- 
gram completer or dropout, academic perfor- 
mance, including grade-point average, "post-tests" 
on assessments of student development over time, 
and information on changes, if any, in original 
plans, and alumni performan * such as other insti- 
tutions attended, performan e in these institu- 
tions, graduate or professional school entry and 
completion, and jobs held. 

A student information system that incorporated 
these facts would allow each institution to examine 
the following: 

1. Student retention rates vproportion of students 
who successfully carried through on their orig- 
inal plans, categorized by gender, ethnicity, and 
so fc/th). 
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2. Student learning and development over time, 
measured through pre-test/post-test changes or 
other methods that prove more successful. 

3. How (1) and (2) are affected by entry characteris- 
tics such as gender, ethnicity, and secondary 
school achievement, and by process factors such 
as courses and programs taken. 

The development of the institutional assessment 
plans described earlier would constitute important 
efforts toward the partial development of the state- 
wide student tracking system. Other efforts should 
proceed from the Commission's ongoing initiative of 
developing a California Comprehensive Student In- 
formation System and should be integrated with 
other related initiatives such as the systemwide 
management information system under develop- 
ment by the California Community Colleges. 



Initiatives to increase the number 
of women and ethnic minorities 
in the teaching "pipeline* 

With the impending escalation of faculty retire- 
ments in California over the next 15 years, coupled 
with the State's rapidly changing student popula- 
tion over this period, initiatives to increase the num- 
ber of women and ethnic minorities in the teaching 
ranks could contribute the most - over the long term 
- to achieving greater student and faculty diversity 
across all the State's institutions of higher educa- 
tion. Specifically, the objectives of these initiatives 
should be two-fold: 

• To actively engage underrepresented students in 
the teaching-learning process through greater in- 
volvement in small learning teams, in teaching 
activities, in faculty rese&rch groups, and in com- 
munity service; and 

• To establish closer working relationships between 
individual faculty members and underrepresented 
students - as an effective means of providing 
these students a valuable educational support 
structure and enhancing their interest and ability 
in conducting research and teaching in an aca- 
demic discipline. 



Two sets of initiatives might be particularly effective 
in achieving the above objectives: 

The first would involve increased financial aid sup- 
port for underrepresented students in the State's 
community colleges and public and independent uni- 
versities, largely in the form of stipends and of teach- 
ing and research assistantships. The "grants" and 
especially the "work-study" aspects of this support 
hold considerable promise in influencing positively 
the college performance of underrepresented stu- 
dents. Collectively, the research literature on the ef- 
fects of student financial aid on student retention 
and persistence suggests that grants and work-study 
assistance have the greatest positive effect on stu- 
dent persistence and performance. Loan forgiveness 
programs also could be considered if their desired 
effect on underrepresented students is established 
and could, for example, be tied to community service 
such as serving as teaching assistants and counsel- 
ors in the elementary and secondary schools. 

The second set of initiatives would provide increased 
support to individual departments and faculty mem- 
bers to: (1) reduce selected faculty members' work- 
load for the purpose of increasing interaction be- 
tween underrepresented students and individual fac- 
ulty members, and of enhancing the faculty mem- 
bers' advising, tutoring and mentoring roles with 
these students; (2) encourage and enable faculty 
members to bring underrepresented students into 
their research groups and teaching activities; (3) es- 
tablish small cooperative learning teams, which 
would be comprised of a small number of faculty and 
community members and underrepresented stu- 
dents; and (4) increase ihe number of slots for gradu- 
ate students in selected departments to accommo- 
date additional underrepresented students. 

Initiatives incorporating the above components are 
perhaps the most justifiable use of the State's limited 
- sources for an incentive funding program for its 
colleges and universities. The priority that the Com- 
mission assigns to these initiatives is premised on its 
recognition that a narrow targeting of the highest 
priorities is essential for a State-level incentive 
funding program if it is to get the "biggest bang for 
the buck" in addressing the most critical shared need 
among all the segments - of achieving greater stu- 
dent and faculty diversity. Yet it should be empha- 
sized that new efforts in this area will likely provide 



the most promising results if they are developed 
through intersegmental collaboration and if they 
build on the segments' related initiatives that have 
proven most successful. 

Additional State support to higher education equi- 
valent to a minimum of 1 percent of the State's bud- 
get for higher education - approximately $50 mil- 
lion - can serve to provide each campus a small but 
still valuable number of teaching and research assis- 
tantships for underrepresented students and can 
also help support each institution's development of 
assessment plans, if these are phased-in over time. 

Based on the preceding analysis, the Commission 
has offered the following four recommendations re- 
garding budget initiatives to address the priorities 
facing California hi^Ser education: 

RECOMMENDATION 1: The Governor and 
Legislature should establish a California chal- 
1 jnge grants program to support initiatives for 
improving teaching and learning in higher edu- 
cation, including the development of institu- 
tional assessment plans. 

RECOMMENDATION 2: The Governor and 



Legislature should establish a California chal- 
lenge grants program to support initiatives for 
increasing the number of underrepresented stu- 
dents in the teaching "pipeline" in California 
education. 

RECOMMENDATION 3: The California Post- 
secondary Education Commission, in collabora- 
tion with the segments and the Intersegmental 
Coordinating Council, should (1) develop the 
appropriate criteria and mechanisms for the ef- 
fective implementation, administration, and 
evaluation of the challenge grants programs 
recommended above, and (2) determine their 
appropriate roles in the administration and the 
evaluation of these programs. 

RECOMMENDATION 4: The Governor and 
Legislature should encourage and support the 
development of a statewide student information 
system that is designed to track individual stu- 
dents throughout their collegiate experience 
and beyond, in order to better understand the 
factors that influence student access and reten- 
tion and to assess the impact of program 
changes on student performance. 
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Appendix A Assembly Bill 2016 (1987) 



Assembly Bill No. 2016 
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CHAPTER 1296 

An act to add a heading to, and to add Article 2 (commencing with 
Section 66910) to. Chapter 11 of Part 40 of the Education Code, 
relating to education, and making an appropriation therefor. 

[Approved by Governor September 28. 1987. Filed with 
Secretary of State September 28. 1967.] 

I am deleting 120,000 appropriation contained in Section 3 of Assembly Bill No. 2016. 
This bill would require the California Postsecondary Education Common on to 
report by January U 1989, on state options for funding higher education based on 
assessment of students and programs, on value-added, or similar performance, or 
incentive funding measures. Also, this bill contains a 420.000 appropriation to fund the 
study. 

The demands placed on budget resources require all of us to set priorities. The 
budget enacted in July, 1987 appropriated nearly 541 billion in state funds. This 
amount is more than adequate to provide the necessary essential services provided 
for by State Government It is not necessary to put additional pressure on taxpayer 
funds for p r o gr ams that fall beyond the priorities currendy provided. 

Thus, after reviewing this legislation, 1 have concluded that its ments do not sum* 
dentiy outweigh the need this year for funding top priority programs and continuing 
a prudent reserve for economic uncertainties. 

I would, however, consider funding the provisions of this bill curing the budget 
process for Fiscal Year 1968-89. It is appropriate to review the relative ments of this 
program in co m par is o n to all other funding projects. The budget process enables us 
co weigh all demands on the state's revenues and direct our resources to programs, 
either new or existing, that have the most merit 
With this deletion, I approve Assembly Bill No. 2016. 

CrORCE DEUXMEJUN, Covernor 

LEGISLATIVE COUNSEL'S DICEST 
AB 2016, Hayden. Higher Education Talent Development. 
Under existing law, the California Postsecondary Education 
Commission is vested with various duties and responsibilities 
regarding higher education. 

This bill would require the commission to develop, implement, 
and oversee a performance-funding program which would allocate 
an unspecified percentage of state funds to public institutions of 
higher education based upon specified performance criteria. 

This bill would require that the California Postsecondary 
Education Commission report to the Governor and the Legislature 
by January I, 1989, as specified. 

This bill would appropriate S20,000 to the California Postsecondary 
Education Commission for the purposes of the bill as it relates to the 
California Community Colleges and the California State University. 
This bill would also direct the commission to fund the purposes of toe 
bill relative to> the University of California from funds available to it 
for that purpose from the Budget Act of 1987. 
Appropriation: yes. 

The people of the State of California do enact as follows: 

5>S- 
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Ql 1296 -2- 

SECTION 1. A heading immediately following the chapter 
heading is added to Chapter 11 (commencing with Section 66900) of 
Part 40 of the Education Code, to read: 

Article 1. General Provisions 

SEC 2. Article 2 (commencing with Section 66910) is added to 
Chapter 11 of Part 40 of the Education Code* to read: 

Article 2» Higher Education Talent Development Act of 1987 

66910. The Legislature finds and declares the following: 

(a) Hie primary goal of every educational institution should be to 
improve and add to the intellectual and personal development of 
each student 

(b) The ultimate measure cf the effectiveness of an educational 
institution is the success of its students in acquiring knowledge, 
competencies, and skills in learning their meaningful application; in 
forming reasoned attitudes, and in examining and adopting values; 
and in developing the capacity for further learning. 

(c) Educational institutions should have the capacity to create 
educational ^n^r^r 1 *"*?, teaching practices, and evaluative 
procedures which enable, stimulate, and encourage significant 
learning for students served* 

(d) The measures ofquality in most colleges and universities often 
fail to evaluate the impact of the institution on the improvement of 
the individual students from entrance to graduation or otherwise 
leaving the institution. 

'(e) The State of California spends nearly five billion dollars 
(33,000,000,000) annually on its system of higher education, but the 
budget formulas tend to be based more on enrollments and physical 
space needs than on rewarding institutions for improvement of 
student learning. 

(f) While every student has a certain amount of underdeveloped 
educational potential, California students appear to (ail short of 
meeting their potential as evidenced by the need for a high number 
of remedial course offerings and inadequate student retention rates. 

(g) Future success in coping with California's critical problems 
through higher education will depend on the development of new 
partnerships and a more cooperative approach to common issues, 
such as transfer and minority student access and retention efforts, on 
the part of all segments of education, kindergarten through the 
university. 

(h) The public would benefit greudy and be well served by 
maximizing educational potentials and improving student 
performance. 

66911, The California Postsecondary Education Commission, 
after consulting with students, faculty, staff, and administrators, at 
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the state and local campus levels and from all segments of public 
postsecondary education, shall develop and present possible options 
for all of the following: 

(a) Measuring and implementing talent development or value 
added approaches to higher education. 

(b) An incentive binding approach designed to develop 
appropriate methods of assessing the teaching and learning process. 
This assessment shall include, but not be limited to, an evaluation of 
the usefulness of the following higher education outcomes criteria: 

(1) The percentage of programs eligible for accreditation that are 
accredited* 

(2) The percentage of the programs that have undergone peer 
review and that have administered a comprehensive exam to 
academic majors. 

(3) The value added by the general education component of the 
curriculum* as demonstrated by the students' performance on 
examinations taken at different intervals during a student's 
experience. 

(4) Demonstration that generalizations about the quality of 
academic programs or services derived from surveys of enrolled 
students, alumni, community members, and employers have formed 
the basis for specific improvement in campus programs and services. 

(5) Demonstration that the quality of teaching has improved as 
evidenced by items, including, but not limited to, the following: 

(A) Student evaluations of faculty and teaclung assistants. 

(B) Availability and utilization of teaching improvement 
programs for facility and teaching assistants. 

(C) The number of undergraduate classes taught by ladder rank 
faculty. 

(D) Faculty involvement in academic advising and class size. 

(6) Demonstration that the quality of campus life has increased as 
evidenced b r / items, including, but not limited to, the availability of 
quality student support services, including, but not limited to, 
affordable student housing, child care services, and academic and 
personal counseling. 

(7) Demonstration of an improvement in the number of women 
and minorities enrolled in, and graduating from, the institutions and 
the number of students successfully transferring from community 
colleges to baccalaureate degree-granting institutions. 

(8) The implementation of a campuswide plan for instructional 
improvement based on findings derived from the above procedures. 

66912. Pursuant to Section 66911, the California Postsecondary 
Education Commission shall be guided by the following principles as 
set forth in its report "Funding Excellence in California Higher 
Education," prepared in response to Resolution Chapter 115, 
Statutes of 1986: 

(a) State funding incentives 'o promote quality in California 
higher education should be funds that are supplementary to the 
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institution $ base budget and premised on a cooperative model, 
where financial incentives are geared toward the aggregate 
performance of the state's whole system of higher education. 

(b> State funding incentives to promote quality improvement in 
higher education should recognize that value-added assessments are 
of greatest value when linked with other data about the students' 
educational experience and when used for institutional 
self-assessment, student counseling, and program evaluation. 

(c) State funding incentives to promote quality improvement in 
higher education should establish that outcome measurements shall 
be tied to the multiplicity of missions, goals, and functions of the 
different segments and institutions of higher education in California. 

(d) State policy on a s s essm e n t and Quality improvement in 
California higher education should establish that the primary 
objective is to assist faculty *nd students to improve the 
teaching-learning process, and that the definition and assessment of 
student outcomes and competency standards at the course, program, 
and departmental level is primarily a faculty responsibility and one 
that should be influenced by student opinion. 

(e) The state-ievel assessment and incentive-funding strategy 
adopted in California to improve the quality of higher education 
should be developed as carefully and rapidly as feasible, and be 
frequently reevaluated in order to ensure effee^veness* 

(f) The state-level strategy adopted in California to fund and 
promote excellence in higher education shall recognize that 
appropriate assessment is but one characteristic of an effective 
institution. The state needs to support and promote a number of 
other institutional activities or practices that not only complement 
the assessment function but that, in toto, must exist in order to 
achieve institutional excellence. 

66913. The California Postsecondary Education Commission shall 
submit a report to the Governor and Legislature not later than 
January 1, 1989, detailing the results of this study and 
recommendations for implementation of state policy to achieve the 
intent of this article. 

SEC 3. The sum of twenty thousand dollars ($20,000) is hereby 
appropriated fircm the General Fund to the California Postsecondary 
Education Commission for the funding of that portion of Article 11 
(commencing with Section 66910) of Chapter 11 of Part 40 of the 
Education Code that is related to the California Community Colleges 
and the California State University. That portion of the act related 
to the University of California is to be funded by the California 
Postsecondary Education Commission from any moneys available to 
it for this purpose from the Budget Act of 1987. 
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Appendix B Sample Networking Documents 



Note: These memoranda and letters illustrate the networking processes 
established by members of the Commission's advisory committee to the AB 
2016 study in order to assume wide discussion of the issues in the study. 



Memorandum from Frank W. Young, The California State University 33 

Memorandum from Lee R. Kerschner, The California State University 35 

Letter from Kirk L. Knutsen, University of California Student Association 37 

Memorandum from the Community College Subcommittee 39 

Letter from Maria Reyes, California State Department of Education 41 

Memorandum from Sherry L. Skelly, California State Student Association 43 

Memorandum from Bernard Goldstein, California State University 

Academic Senate 45 
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Memorandum 



Trustees of The California State University 



Martin M. Ahuraada Date: 29 October 1987 

Senior Policy Analyst 
California Posts econdary Education 
Commission 



i * 

•' f : y 

From: Frank W. Young 
Associate Dean * 
Academic Program Improvement 



PLAN FOR UNIVERSITY COMMUNITY DISCUSSIONS OF STA TE INCENTIVE 
APPROACHES 

In accordance with the agreement reached at the October 9, 1987, meeting of the 
Advisory Committee on State Incentive Funding Approaches, I am writing to inform 
you of the process we have initiated to involve facility, administrators and students 
on the nineteen CSU campuses in discussion of the issues raised by the charge of 
your committee. 

As may be noted in the appended memorandum to Academic Vice Presidents, our 
approach is to ask each campus to propose options for incentive funding programs 
for consideration by a system lev<;l advisory committee. The members of this body 
include: a campus President, a Vice President for Academic Affairs, three faculty 
nominated by the statewide Academic Senate, two representatives of the California 
State Student Association and two persons from the Chancellor's staff. 

The CSU Assessment Advisory Committee, as the group will be known, will provide 
guidance in preparing recommendations to the Chancellor and to the State Incentive 
Funding Advisory Committee. 

After due consideration, we have decided against circulating copies of the San 
Mateo conference report, Educating the Changing Student Population for a Changing 
World. Some of the recommendations regarding assessment in that report are of 
such a nature as to undermine the credibility of the current round of discussions. 

If you have any questions about the process, please do not hesitate to contact me. 

FWY/na(APPSTWO: 1 183n) 
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cc: Lee R. Kerschner 
Ray Geigle 
Sally L. Casanova 

CSU Members, State Incentive Funding Advisory Committee 
Members, CSU Assessment Advisory Committee 
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THE CALIFORNIA STATE UNIVERSITY 
Office of the Chancellor 
400 Golden Shore 
Long Btach, California 90802-4275 
(213) 590- 



Code: APPS 87-31 



Date: October 28, 1987 

To: Vice Presidents 
Academic Affairs 

From: Lee R. Kers 

Vice Chancellor 
Academic 

Subject: State Incentive Funding Approaches 



Reply Requested by 
January 11, 1988 




Attached please find a copy of Assembly Bill No. 2016, "Higher Education Talent 
Development," that has been signed by the Governor. In accordance with the bill, the 
California Postsecondary Education Commission has established an Advisory Committee 
on State Incentive Funding Approaches for Promoting Quality in California Higher 
Education. Six members of that committee are from The California State University: 

Dr. Bernie Goldstein, Academic Senate, CSU, San Francisco 

Dr. Diane Halpern, CSU, San Bernardino 

Dr. Glenn Irvin, CPSU, San Luis Obispo 

Dr. Leigh R. Mintz, CSU, Hayward 

Ms. Sherry Skelly, CSS A 

Dr. Frank Young, Chancellor's Office 

The anticipated outcomes of the CPEC study (for which a proposed prospectus is 
attached) are a list of quality improvement options or proposals designed to: 

1. Stimulate institutional practices to promote quality in higher education; 

2. Provide greater accountability for the quality and content of college instruction; 

3. Understand better how the budget process can be used to improve the educational 
process. 

As it? ♦itle implies, Assembly Bill 2016 specifies that the options CPEC is to develop and 
present to the Legislature focus on measuring gains in student learning and on assessing 
the effectiveness of the teaching-learning process. 

Tn fulfilling its charge to develop State funding incentives to achieve these ends, AB 2016 
requires CPEC to consult with "students, faculty, staff, and administrators at the state 
and local campus level." This provision is consistent with the guiding principles developed 
by the ACR 141 Task Force last year and incorporated into the text of the legislation 
(Section 66912). These principles recognize that "the definition and assessment of student 
outcomes and competency standards at the course, program and departmental level is 
primarily a faculty responsibility." 
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The CPEC advisory committee has ascertained that it will begin its work by requesting 
that as many faculty and administrators as possible be polled on the following question: 

How can incentive funding be used at the course, departmental, university, system 
and state levels to effect improvement in educational quality? 

I am asking each campus to consider this complex question and to propose options 
amenable to incentive funding. In soliciting recommendations, campuses should keep in 
mind the legislative stipulation (page 5) that "State funding incentives to promote quality 
in California higher education should be funds that are supplementary to the institution's 
base budget . . .." Please return your recommendations to Or. Frank Young oy January 11, 
1988. 

To coordinate the CSU responses to the CPEC advisory committee, and to address related 
issues raised in supplemental budget language (copy attached), the CSU Assessment 
Advisory Committee is being established. Dr. Young will convey campus responses to this 
group whose members will be asked to compile the system report. 

You may be interested to know that this question will be discussed with the campus 
Senate chairs when they meet at Asilomar on November 13, and will be a topic of 
discussion at an Academic Senate Retreat worksite? on November 14. However, the 
Retreat discussions are not intended to produce campus or system responses. 

Please call Dr. Frank Young at (213)590-5856 or ATSS 635-5856 if you have any questions. 



LRK/na(APPSTWO:l 161n) 
Attachments: 2 



Copies to: 

Presidents 

Associate Vice Presidents, Academic Affairs 

Academic Senate, CSU 

Chancellor's Office Staff 

Campus Faculty Senate Chairs 

CPEC Committee Representatives 

CSU Assessment Advisory Committee Representatives 

Chair, California State Student Association 
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October 27, 1987 



Martin M. Ahumada 
Senior Policy Analyst 
California Postsecondary 

Education Commission 
1020 12th Street, 3rd Floor 
Sacramento , CA 95814 

Dear Martin, 

As requested, I have outlined the process through which UCSA 
plans to solicit student input into identifying "quality 
factors" for consideration by the AB 2016 Advisory 
Committee . 

1. The UCSA Academic Affairs Committee, 

As one of three standing policy committees on UCSA's 
Board of Directors, the Academic Affairs Committee will meet 
in November to consider the question of quality factors, as 
it relates to the work of the Advisory Committee. Committee 
members will be briefed on the work of CPEC and will be 
advised to solicit student input on their campuses. UCSA 
staff will receive lists of potential quality factors from 
the committee members by the end of December . 

2. The UCSA Council on Academic Affairs 

The Council on Academic Affairs is an advisory body to 
the UCSA Board of Directors and is comprised of each campus 
student government's academic affairs specialist. The 
Council on Academic Affairs is also meeting in November and 
we plan to use with them the same consultive process we 
have outlined for UCSA's Academic Affairs Committee. We also 
expect to receive responses from the members of this group 
by the end of the year. 

3. Student Body Presidents and Other Interested Students 

We plan to distribute a packet of background information 
asking for input on this issue to numerous student leaders 
in the U.C. system, including all of our Student Body 
Presidents. We also expect to receive feedback from these 
persons by the end of the year. 

4. Final Identification of "Quality Factors" 

Upon receipt of all student responses, UCSA staff in 
Sacramento will review the collected materials and formulate 
a final recommendation for consideration by our Board of 
Directors at their January meeting. Staff recommendations 
will then be reviewed by our Academic Affairs Committee ♦ 
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which will adopt or amend our proposal and send it on to the 
full Board of Directors for final approval. 

Upon adoption by the Board of a final set of 
recommendations, we will forward a copy to your office. We 
anticipate no problem with meeting the January 29 deadline 
outlined in your October 14 memo. 

I hope this brief outline provides you. with the information 
you need. If you have any comments, questions, or 
suggestions regarding our proposed consultive process, 
please don't hesitate to call. 




Kirk^ET Knutsen 
Associate Director 



cc: Jim Lites, Chair UCSA 

Academic Affairs Committee 
Adrienne Graham 
file copy (3) 



LONG BEACH COMMUNITY COLLEGE DISTRICT 




BARBARA J. KALBU3 

INTERIM SUPERINTCNOENT-PRBSIOCNT 



4001 CAST CARSON STREET 
LONG BEACH. CALIFORNIA 90808 



January 14, 1988 



■OAPO Of TRUSTIES 

HUGH OAVIO BURCHAM 
C THOMAS OBAN 
TRUOY POLSKY 
OONALO M SCOTT 
RUTH TOOO 



Martin M. Ahumada 
Senior Policy Analyst 

California Postsecondary Education Commission 

Community College Subcommittee of the CPEC AB 2016 Advisory Committee on State 
Incentive Funding Approaches for Promoting Quality in California Higher Education 
Martha Kanter, California Community Colleges Chancellor's Office 
Barbara Kalbus, Long Beach City College 
Eric J. Nicolet, Ventura College 
Bob Turiey, San Bernardino Valley College 

Consultative Process 

Wide participation and involvement from all community college constituencies will be sought and 
encouraged through the Chancellor's consultative process, two field advisory meetings on the California 
Community Colleges Board of Governors' 1988-89 Basic Agenda, to be held February 5 at San 
Fnwcisco City College and February 1 1 at El Camino College, and conferences. The conferences are: 
CACC Asilomar Research Conference: Measuring Community College Success, April 13-15, 1988, 
and Institutional Effectiveness Conference, to be held at Rancho Santiago College, April 28-29, 1988. 

The following constituent groups will be consulted: 

1 . Chief Executive Officers Council 

2 . Chief Instructional Officers Council 

3 . Statewide Academic Senate 

4 . Council of Student Body Governments 

5 . Chief S tudent Services Officers Council 

6 . Chief Business Officers Council 

7. Californians (Council of 14 Community College Organizations, such as ACCCA, CEOs, CCCT 
CTA, CSEA, Academic Senate, CFT, FACCC, CACC, California Student Associations of 
Community Colleges) 



From: 



Subject: 



CD IfMBfRAL ARTS CAMPUS 
L 1 W M EAST CARSON STRUT 
fa^TOH I Hl BEACH. CALIFORNIA tOSOS 
TELEPHONE. jtlSj 410*4111 



LONG BEACH CITY COLLEGE 



PACIFIC COAST CAMPUS 
1305 CAST PACIFIC COAST HIGHWAY 

LONO BEACH CALIFORNIA SOBOS 
lELEgMOMfc Ilia! 41Q-4111 



8. Statewide field meetings of groups not represented above: Accrediting Commission 

for Community and Junior Colleges, California Association of Fostsecondary Educators of the 
Disabled, California Community College Admiiastrators of Occupational Education, California 
Community College Occupational Education Coalition, California Community College 
Counselors A sso ciat ion, LaRaza Faculty Association for the California Community Colleges, 
Learning Resources Association of the California Community Colleges, Western Region - 
Council on Black American Affairs, EOPS Association, Affirmative Action Task Force, 
California Community College Council of Community Services and Continuing Education, 
California Community College Student Affairs Association, California Community College 
Student Financial Aid Association, English Council of California Two-Year Colleges, Health 
Services Association of the California Community Colleges. 

In addition, the C h a n cello r 's Office will also rfi«sgn«n«^ a questionnaire for direct input from CEOs, 
QOs, CSSOs, Academic Senate Presidents, and Student Body Presidents. 

The purpose of die consultative process will be to review the CPEC draft report of the various S tote-level 
models for funding or budgeting quality initiatives in higher education. 



cc Advisory Committee 
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CALIFORNIA STATE DEPARTMENT OF EDUCATION 


Bill Honig 


721 Capitol Matt; P.O. Box 944272 


Superintendent 


Sacramento, CA 94244-2720 


of Public Instruction 



December 3 , 1987 



Martin M. Ahumada 
Senior Policy Analyst 

California Postsecondary Education Commission 
1020 12th Street, 3rd Floor 
Sacramento, CA 95814 

Dear Martin: 

I am responding to your request to report on the process through 
which the Department of Education will be advising and assisting 
the Commission to develop a number of options for improving 
quality in California higher education. 

As a representative from the Department, the views expressed by 
me will be the result of consultation with the Superintendent of 
Public Instruction and with selected colleagues in the Department 
and in the field who are knowledgeable and actively involved in 
intersegmental efforts and issues of quality in higher education. 

Although I understand that we are not being asked to obtain an 
official" endorsement from our respective segments, our input 
will reflect the best thinking of my colleagues on the issue of 
incentive funding for student o" comes assessment as it relates 
.. -j K-12 education. 

Thank you very much for the opportunity to work with you on this 
pro j ect . 

Sincerely, 

Maria Reyes, Consultant 
Intersegmental Relations Division 
(916) 323-0546 

MR: cm 
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California State Student Association 

926 J Street, Suite 701 • Sacramento, California 95814 • (916) 441-4514 

4CO Golden Shore • Long Beach, California 90802-4275 • (213) 590-5560 • ATSS 635-5560 

■ 

November 12, 1987 

TO: Martin M. Ahumada, Cl'EC Senior Policy Analyst 

FROM: Sherry L. Skelly, CSSA Legislative Director^h, 
cc: CSSA Board of Directors 

John Richardson, CSU student representative, 
CPEC Committee on State Incentive Funding Approaches 

RE: Process Letter for Committee on State Incentive Funding 

Approaches 




As agreed to by the Committee, I am submitting a process outlined 
by our Associat ion , in order to facilitate communication regarding 
quality/assessment and budget incentive options from the student 
perspective on each of the 19 CSU campuses. 

It is ray understanding that the results of this process shall not 
constitute an official position of thr CSSA on any particular 
proposals at this time, but instead it is our responsibility to 
provide the opinions and perspectives of CSU students at large. 

To recieve feedback at the campus level, John Richardson and the 
CSSA Board shall: 



1. Schedule forums at the campus 
the CPEC committee and staff. No 

possible by the deadline. 



level on issues identified by 
more than 3 to 5 forums m a v be 



2. Survey assessment programs m other states from the sr^i^nt 
perspective. 

3. Schedule a special statewide session on Talent Development and 
Assessment January 9th or 10th at Cal Poly San Luis Obispo. 
Students from all 19 campuses will be present. 

4. Mail ques t l onai res to each of the 19 student academic affairs 
commi t tees, to be comp let ed and returned by early January . 




Please, contact John Richardson for progress reports on the 
above proposals. 

I have enjoyed working with you and the \CR 141 Task Forr^ iv-r 
the past year. I wish the committee and staff all the best on a 
very comp J ex but exciting" project. 

M 

representing 340,000 students statewide 
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400 Golden Short. Suite 134, Lon% Beach, California 90802-4273 • (213) 390-3378 or 3330. A TSS; 635-5578 or 5550 



OF 



THE CALIFORNIA STATE UNIVERSITY 



ACADEMIC SENATE 



MEMORANDUM 



OATE: November 2, 1987 



TO: 



Hal Charnofsky, Chair 



Academic Affairs Committee 
Chairs, Campus Senates /I 




FROM: 



Bernard Goldstein, Assessment Specialist 
Academic Senate CSU 



SUBJECT: Incentive Funding Approaches for Promoting 
Quality in California Higher Education 



Recently, AB 2016 (Hayden) entitled "Higher Education Talent Development" 
was signed by the Governor. The bill requires the California Postsecondary 
Education Commission to develop a performance-funding program which would 
allocate an unspecified percentage of state funds (based on specified 
performance criteria) to public institutions of higher education. The bill 
requires the Commission to report to the Governor and the Legislature by 
January 1, 1989 and includes the following important provisions: 



1 . "a. State funding incentives to promote quality in 
California higher education should be funds that are 
supplementary to institutions base budget and premised on a 
cooperative model, where financial incentives are geared 
toward the aggregate performance of the state's whole 
system of higher education.' 1 

2. "d. State policy on assessment and quality improvement 
in Ca lifornia higher education should establ ish that the 
primary objective is to assist faculty and students to 
improve the teaching-learning process, and that the 
definition and assessment of student outcomes and competency 
standards at the course, program, and departmental level is 
primarily a faculty responsibility and one that should be 
influenced by student opinion." 



The California Postsecondary Education Commission has established an 
intersegmental "Advisory Committee on State Incentive Funding Approaches for 
Promoting Quality in Higher Education." The charge to the advisory committee 
is to coordinate activities as required by AB 2016, As a member of the 
committee, I have urged that significant consultation take place, particu- 
larly at the campus level , to ensure faculty participation and decision 
making on all issues concerning state incentive funding and quality. Vice 
Chancellor Lee Kerschner has mailed copies of a memorandum outlining the 
CSU's initial approach on incentive funding to Campus Vice Presidents of 
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November 2, 1987 
Page Two 



Academic Affairs and Academic Senates. Included 1n the materials are copies 
of AB 2016, a CPEC "Prospectus" on "State Funding Approaches for Promoting 
Quality 1n California Higher Education" and a 11st of advisory committee 
members . 

The faculty of the CSU are being asked to begin the process of consultation. 
I have listed below the questions I believe to be the most Important — see 
page 3 of the "Prospectus": 

1. "How 1s quality 1n higher education measured — at the 
student, program, and Institutional levels — and how could 
State Incentive funding approaches deal with each level?" 

2. "How can the State budget be appropriately utilized as 
a tool for encouraging Institutions to Improve the 
educational process?" 

Hay I suggest that the campus senates begin discussions concerning these 
questions as soon as possible. Incentive funding will be one of the topics 
of discussion when the statewide Senate meets with the campus senate chairs 
at the Aslloraar Academic Retreat on Friday, November 13th. Finally, I am 
asking that the Academic Affairs Committee of the statewide Senate address 
the above question at Its next several meetings. It 1s clear that we will 
have until January 23, 1988 to synthesize our thoughts on these questions. 

These steps apparently are only a beginning. A reVsed schedule for the 
work of the CPEC advisory committee 1s Included on page 4 of the CPEC 
"Prospectus." Please note that the advisory committee 1s being asked tc 
provide preliminary answers to the above questions and more by January 29, 
1988. I would very much appreciate receiving your Ideas, thoughts and 
senate positions (1f any) on Incentive funding by January 27, 1988. 

I suggest that one Important area open for possible incentive funding in the 
CSU 1s the disciplinary certification process for prospective teachers. 

Please feel free to contact me 1f you have any questions or concerns about 
the Issues I have outlined above. 

Bernard Goldstein 
Department of Biology 
San Francisco State University 
(415) 591-2576 



BG/he 



cc: Or. Martin Ahumada CPEC 
Or. Frank Young 
Executive Committee 

Or. Sandra Wilcox |<j 
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Higher Education Assessment 
Nationally and in California 



In educational circles, assessment commonly refers to 
any process of gathering concrete evidence about the 
impact and functioning of education. The term can ap- 
ply to processes that provide information about indi- 
vidual students, about curricula or programs, about in- 
stitutions or about entire systems of Institutions. As 
the Education Commission of the States has noted, the 
term encompasses a range of procedures including 
testing, survey methods, performance measures or 
feedback to individual students, resulting in both 
quantitative and qualitative information (1987, p. 1). 



Developments in assessment nationally 

Assessment in American higher education is not a new 
phenomenon. It has a long tradition as both an inte- 
gral part of instruction and as a means for reassuring 
public constituencies of the individual and societal 
benefits of higher education. 

The recently renewed interest in assessment in higher 
education was encouraged in large part by the books 
and reports of influential education leaders and dis- 
tinguished national panels calling widespread at- 
tention to the needed improvements in the quality of 
higher education and, particularly, to the role of 
assessment in achieving and judging these improve- 
ments. 

In Involvement in Learning (1984) ~ the report most re- 
sponsible for catapulting assessment to the center 
stage of the current national debate about the quality 
of higher education - the Study Group on the Condi- 
tions of Excellence in American Higher Education 
argued that effective learning required high student 
involvement and expectations, including a systematic 
approach to assessing students' knowledge, capacities 
and skills. 

The Association of American College's report, Integrity 
in the College Curriculum (1985) stated that: "One of 
the most remarkable and scandalous aspects of Ameri- 



can higher education is the absence of traditions, prac- 
tices, and methods of institutional and social account- 
ability" (p. 33). The report went on to recommend that 
faculty assume the fundamental responsibility for "de- 
signing and monitoring the mechanisms of assess- 
ment.'' 

Paralleling the above developments were expanding 
views of educational quality that emerged within aca- 
deme itself. For some time, for example, Alexander 
Astin has been proposing a new approach to measuring 
and promoting educational excellence, namely, one 
that emphasized the educational impact or "value 
added,* 9 since "true excellence resides in the ability of 
the college or university to affect its students favor- 
ably, to enhance their intellectual development and to 
make a positive difference in their lives" (1944, p. 27). 
Astin's views found their most recent and eloquent ex- 
pression in Achieving Excellence in Education (1985), 
in which he contends that traditional gauges of an in- 
stitution's excellence, namely its resources and reputa- 
tional rankings, are less meaningful than irdicators of 
its contributions to the intellectual and knowledge 
gains of students. 

In 1986, several key reports signaled, and perhaps 
even expedited, the emergence of assessment on the 
active policy agenda at the state level. Among these 
were Time for Results by the Task Force on College 
Quality of the National Governor's Association, and 
Transforming the State Role in Undergraduate Edu- 
cation by the Working Party on Effective State Action 
to Improve Undergraduate Education of the Education 
Commission of the States. In the latter, assessment 
was endorsed by the task force as one of five broad 
strategies to improve undergraduate education, refer- 
ring to it as "an integra ~t of an institution's strate 
gy to improve teaching and learning and of the state's 
strategy to monitor the effectiveness of higher educa- 
tion" (p. 32). Moreover, the task force's recommenda- 
tions, while directed at state leaders, called for a com- 
prehensive approach to evaluating student and institu- 
tional outcomes requiring state- and campus-level 
agreement about the purposes and expected outcomes 
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of assessment programs as well as the capacity to eval- 
uate the extent to which students were being served 
and state priorities were being met. 

Many recent state and institutional initiatives to im- 
prove the effectiveness of higher education have been 
placed under the assessment umbrella. Yet although 
th* term assessment has assumed numerous connota- 
tions that are often used interchangeably, it is more 
frequently equated with student testing for admission, 
progression through and graduation from college, and 
with evaluation of the effectiveness of programs and in- 
stitutions of higher learning. In The Growing Interest 
in Measuring the Educational Achievement of College 
Students (1985) - a raport prepared for a recent con- 
ference on assessment, Terry W. Hartle describes six 
separate but overlapping facet* of assessment in high- 
er education that provide a useful analytic framework 
for illustrating the range of state and institutional as- 
sessment activities that are receiving much attention 
today. 

t. Multiple measures and observers to track intellectual 
and personal growth over on extended period of time. 

Perhaps the country's most notable example of this 
approach is the institution-wide assessment program 
at Aiverco Collage in Milwaukee - a small liberal arts 
institution for women. Alverao's "competency-based" 
student assessment program emerged out of an over- 
haul of the curriculum to emphasize student competen- 
cies or "general abilities " in one or more of eight core 
areas: effective communications ability; analytical ca- 
pability; problem solving ability; valuing in a decision- 
making context; effective social interaction; effective* 
nets in individual and environmental relationships; 
responsible involvement in the contemporary world; 
and aesthetic responsiveness. Moreover, students 
must demonstrate competence at six levels of perfor- 
mance within these eight areas. While the same 
assessment criteria are applied to all disciplines - a 
process that involves more than 100 distinct exercises 
over the students' four college years - the assessments 
are conducted by various parties: students, faculty 
members, community members, and expert assessors. 
Th* assessment results are used to tailor each stu- 
dent's program as well as to assist faculty to improve 
the institution's overall academic program. (More in- 
formation about Alverao's assessment program can be 
found in Mentkowski and Loacker, 1985.) 



2. State-mandated requirements to evaluate students 
and/or academic programs. 

A 1987 survey of all 50 states conducted by the Edu- 
cation Commission of the States found that two-thirds 
of the states had formal initiatives labeled "assess- 
ment" - an indication that the state-level discourse on 
assessment has become more aggressive - yet it re- 
ported few state-mandated assessment programs have 
been established Such programs have been widely 
viewed as among the most ominous efforts by state pol- 
itical leaders to improve the quality of higher educa- 
tion. In addition, despite their high visibility on the 
national assessment landscape, there remains growing 
controversy regarding the rationale, effectiveness, and 
actual consequences of these programs. New Jersey, 
Florida, and Georgia appear to have the most visible 
and widely-discussed state-mandated assessment pro- 
grams. 

New Jersey: The New Jersey approach has aimed at 
assessing students for counseling and placement in all 
public institutions of higher education with some inde- 
pendent institutions participating on a voluntary 
basis. Specifically, the New Jersey College Basic 
Skills Placement Test was created in 1977 to assess the 
basic skills proficiencies of entering freshmen and to 
evaluate the effectiveness of each institution's reme- 
dial efforts. The exam was developed in cooperation 
with the College Board and the Educational Testing 
Service and involves an essay exercise plus multiple- 
choice questions in elementary algebra, computation, 
reading comprehension, and sentence logic. 

The known success of the New Jersey program has 
prompted several states to begin considering a similar 
state-wide approach to assessing the basic skills of en- 
tering freshmen. In California, for example, the pas- 
sage of Assembly Bill 3 (Campbell, 1986) resulted in 
the 1987-88 implementation of the Statewide Matricu- 
lation Plan of the California Community Colleges. 
This plan provides funding for a six-component pro- 
gram of admission, orientation, assessment, advise- 
ment, follow-up, and evaluation available to each Com- 
munity College student. The plan enables the Commu- 
nity Colleges to provide in-depth diagnostic assess- 
ment of students' basic skills, educational aspirations, 
and program goals. 

Florida: Florida uses student testing as a "promotion- 
al gate" to ensure students' readiness to progress to a 
higher level of education or to receive their degree. All 
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its high school seniors are required to pass a statewide 
test in order to receive their high school diploma. In 
addition, all its public university students are required 
to pass all four tests of the College Level Academic 
Skills Project (CLASP) in order to obtain junior stand* 
ing, and all community college students must also pass 
the tests to obtain the associate degree. The CLASP 
exam assesses students' communications skills in read- 
ing, writing and speaking. In the area of mathematics, 
the exam measures skills in algorithms, concepts, gen- 
eralizations, and problem solving. 

According to Florida's political and higher education 
leaders, the state's mandated use of standardized tests 
has led to the acceptance of basic skills concepts, the 
effective targeting of remedial education, and greater 
public assurance of the quality of higher education. In 
addition, Florida officials contend that diagnostic test- 
ing for counseling and course placement serves the 
purposes of: (1) increasing the "success rate" for fac- 
ulty and students by having students better matched 
with the curriculum; (2) providing a more effective 
system of remedial education; and (3) helping define 
standards of accomplishment, since the "open-door en- 
try" process gives students no real notion of what 
achievement is expected of them. Yet, there is growing 
controversy about the standards for the rising junior 
examination in Florida, including the issues of faculty 
members' "teaching to the test* 9 and the lowering of 
cut-off scores for the exam owing to its low passage rate 
by ethnic minority students. Clearly, the uncritical 
reliance on standardized tests is a serious issue and 
one that should be of much concern to all. 

Georgia: In Georgia, all college and university stu- 
dents are required to pass the Board of Regents Exami- 
nation - comprised of a one-hour Reading Test and a 
one-hour Essay Test - in order to achieve junior status. 
The Reading Test consists of five to eight questions on 
each of ten reading passages and serves to assess, for 
example, literal and inferential comprehension. The 
Essay Test is similar to the California State Universi- 
ty's Graduate Writing Assessment Requirement in 
that it employs multiple faculty evaluators to judge 
student's writing proficiency. Students may retake the 
exam until they pass and in order to graduate. In cer- 
tain instances, then, a situation may develop where 
the testing process transitions from "promotional gate 
testing 1 " to "graduation testing." 



3. A shorthand way of focusing on the "value added" by 
postsecondary education. 

Value-added assessments are approaches to measuring 
changes or gains in students' knowledge, attitudes and 
skills between the beginning and the end of their col- 
legiate experience. The Northeast Missouri State Uni- 
versity in Knoxville provides a good example of an in- 
stitution-wide value-added assessment program that 
has attracted national attention. Its evolution from a 
teachers college to a multi-purpose university gave the 
institution the impetus in the early 1970s to develop a 
value-added assessment program in order to know if it 
was producing nationally competitive graduates in its 
diverse fields as well as demonstrate that its instruc- 
tion made a positive difference in each student's 
knowledge, attitudes, and skills. The University has 
assessed the achievement of its students in their gener- 
al education programs and in their majors through the 
use of standardized examinations, such as the Gradu- 
ate Record Examination and the College Outcome 
Measures Project tests of the American College Test- 
ing Program. It also administers questionnaires at 
each college year to examine changes over time in stu- 
dents' educational goals, their choice of major, their 
overall perceptions of the institution, and their prog- 
ress toward specific educational outcomes and the uni- 
versity's general education objectives. 

Value-added assessments that are thoughtfully de- 
signed and carefully controlled can assist an institu- 
tion to better understand the student changes and 
growth that are attributable to education-related ex- 
periences, anH can serve as a stimulus for program 
change and auricular improvements by demonstrat- 
ing where performance falls short of expectations. Yet, 
the value-added assessment programs that have been 
implemented to date and that are looked upon as 
models for possible evaluation by other institutions re- 
main controversial, owing largely to their limitacions 
in recognizing and accounting for key variables which 
influence student performance, such as students' mat- 
uration rates, general intellectual developments, prior 
experience, and reasons for enrolling in the course or 
program. Also, some questions of method and mea- 
surement, such as the practical difficulties of establish- 
ing reliable baseline data and control group informa- 
tion, remain unresolved issues. 
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4. Standardized tests to examine either general or spe- 
cialized knowledge. 

Most institutions have developed their own methods 
for measuring students' general and specialized knowl- 
edge. Examples of the standardized, objective tests 
often used for this purpose are the College Outcomes 
Measures Program (COMP) assessments of the Ameri- 
can College Testing - perhaps the most widely used 
general education battery - and the Graduate Record 
Examination (GRE) Subject Tests of the Educational 
Testing Service, which are used to assess the special- 
ized knowledge and skills students achieve in their 
major field. The Subject Tests are offered in biology, 
chemistry, computer science, economics, education, en- 
gineering, French, geology, Idstory, literature in En- 
glish, mathematics, music, physics, political science, 
psychology, sociology, and Spanish. The COMP exam 
offers three options to assessing the outcomes of gener- 
al education. The first two are the Composite Exami- 
nation and the Objective Test, which cover the three 
"process 19 areas of oral and written communication, 
problem solving, and values clarification, in addition 
to the three "content" areas of "functioning within 
social institutions," "using science and technology" 
and "using the arts." The third COMP option is the Ac- 
tivity Inventory, which is used to elicit directly from 
students the effects of general education on the same 
process and content areas of the Composite and Objec- 
tive examinations. 

It is important to reiterate, however, that the un- 
critical reliance on standardized tests must be avoided, 
owing to the significant risks associated with the inap- 
propriate use of standardized test results and with the 
unreliability of these in predicting students' college 
performance. 

5. A way of making decisions about funding by reward- 
ing institutions for student performance on estab- 
lished criteria. 

Perhaps the best illustration of this dimension of 
assessment is Tennessee's Performance- Based Fund- 
ing Program discussed in Part Three above. Although 
state encouragement of outcomes assessment in higher 
education is on the rise, few state officials have en- 
couraged the adoption of a performance-based funding 
approach. A major criticism of this approach stems 
from the perception that the "new* funds for higher 
education appropriated by the legislature for alloca- 
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tion through such a program are actually funds that 
would otherwise have gone into the general budget of 
the state's colleges and universities. Also, it is difficult 
to establish meaningful and reliable criteria to guide 
performance funding. Moreover, if incorrectly de- 
signed, these funding strategies could have the ironic 
and often unintended consequence of denying improve- 
ment monies to institutions most in need of improve- 
ment Yet officials of Tennessee's institutions believe 
that these funds are indeed "new* 9 money and that, 
overall, the performance-based plan has been instru- 
mental in enhancing the educational quality of their 
programs. 

6. Measuring changes in student attitudes and values. 

Undoubtedly, one of the most valuable contributions 
made by higher education institutions is their ability 
to develop in students the attitudes, beliefs, values, 
and behaviors that are personally redeeming and bene* 
ficial to society among them: enhanced moral and 
emotional sensibilities; tolerance for ambiguity and di- 
versity, improved performance in and commitment to 
responsible citizenship; and positive self-identities 
needed to live rewarding lives within their family and 
professional roles. Thus, in addition to assessing their 
students' cognitive development, colleges and universi- 
ties have been particularly interested in gauging 
changes over lune in their students' attitudes and 
values. 

While most institutions have developed their own in- 
struments to assess change in this area, a number of 
commercially developed instruments are available for 
examining students' attitudinal development and 
growth. For example, over 600 institutions currently 
participate in the Cooperative Institutional Research 
Project's (COP) Annual Survey of American College 
Freshmen, and a smaller but significant number of 
other institutions use the NCHEMS/Coilege Board Stu- 
dent Outcomes Information Service (SDIS) instruments. 
The CHIP was established in 1966 by the American 
Council on Education and its surveys are now admin- 
istered by UCLA's Higher Education Research Insti- 
tute. In 1987, 289,875 freshmen enrolling in 652 two- 
and four-year institutions across the country returned 
completed CIRP surveys. The CIRP Annual Freshman 
Survey is the nation's largest and oldest continuing 
empirical study of demographic, experiential, and atti- 
tudinal information about college students. In 
addition, there is a CIRP Follow-up Survey used to con- 

46 



duct longitudinal studies of entering freshmen and 
which focuses on students' satisfaction with their col- 
lege experience. 



Assessment in California 

Matriculation in California's Community Colleges is 
the State's only mandatory statewide assessment pro- 
gram in higher education, although both the Uni- 
versity of California and the California State Univer- 
sity employ common assessment efforts at the system- 
wide levels, and the independent institutions use a 
variety of assessment instruments. 

Given the size and diversity of the State's higher edu- 
cation enterprise, a comprehensive inventory of the 
broad range of assessment activities in place or being 
proposed on each campus would be a tall order to meet. 
Yet, even a cursory overview of these serves to uemon- 
strate that a vast and complex array of system- and 
campus-wide evaluation efforts have been under way 
for some time, and stem from self-initiated reflection 
and reexamination of the quality of teaching and stu- 
dent learning, program effectiveness and the accom- 
plishment of institutional mission. Much of the im- 
petus for these activities can be traced, for example, to 
such recent reports as Lower Division Education of the 
U niversity of California (commonly referred to as the 
Smelser Report) of the University of California, the 
Academic Senate Self Study of Undergraduate Educa- 
tion of the California State University, and the State- 
wide Matriculation Plan of the California Community 
Colleges. 

It should be acknowledged, therefore, that assessment 
efforts and discussions in California higher education 
were initiated by the segments and campuses and 
largely in recognition of their merits rather than in re- 
sponse to external pressures. 

The primary impetus for addressing assessment in 
California higher education as a matter of State policy 
or statute has come about recently from ACR 141 
(Hayden, 1986), Afi 2016 (Hayden, 1987), and Supple- 
mental Language to the 1987 Budget A^* In the lat- 
ter, the Legislature's intention was "to seek t>e devel- 
opment and adoption of comprehensive assessment 
mechanisms for evaluating student learning, program 
effectiveness, and institutional accomplishment of mis- 
sion for public postsecondary education" in order to re- 
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view educational budget expenditures more effective- 
ly. The University of California responded to this leg- 
islative intent in its Report to the Legislature on Uni- 
versity of California Progress in Comprehensive Out- 
comes Assessment: A Response to Supplemental Lan- 
guage to the 1987-88 Budget Act (1988). The Califor- 
nia State University responded to the intent in its Re- 
port to the Joint Legislative Budget Committee, Pursu- 
ant to Section 9, Budget Act of 1987, Item 6610-001-001 
''Student Outcomes Assessment. " 

The above reports provide a useful, albeit contained, 
overview of the broad range of traditional evaluation 
approaches the University and State University have 
employed, including: student testing for admission, 
placement, and graduation and licensure; program re- 
view, including curricular approval and improvement 
processes; program and institutional accreditation; 
and surveys of current and former students to deter* 
mine their satisfaction with their educational experi- 
ence. The following discussion of assessment in Cali- 
fornia higher education comprises a synthesis of these 
reports, including the Statewide Matriculation Plan of 
the California Community Colleges and, particularly, 
the recent report of the Subcommittee on Student 
Assessment of the California Education Round Table, 
Systemwide and Statewide Assessment in California, 
April 1988 Draft. 

Finally, because the purpose of this review is merely to 
describe the established systemwide assessment pro- 
grams and practices in California higher education, it 
is not exhaustive nor is it designed to discern the policy 
implications of these programs and practices. 

Assessment for admissions and placement 

The Math Diagnostic Testing Project: Four levels of 
multiple-choice, diagnostic tests are administered 
under the Math Diagnostic Testing Project to ^uge 
students' ability to progress to the next college-prepa- 
ratory mathematics course from Algebra I through 
Calculus. The results of the assessment are used for 
curriculum development and in-service programs as 
well as for individual-student counseling and appropri- 
ate placement and remediation. While these tests are 
given on a voluntary basis, they are used by all the 
University of California campuses, 13 of the California 
State University campuses, and 24 of the State's 106 
Community Colleges, as well as 816 middle schools or 
high schools throughout the state. 

ih 
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Intersegmental Writing Diagnostic Exams: The Inter* 
segmental Writing Diagnostic Exams are two-hour 
essay-form tests designed to assist students and teach- 
ers to understand the University's and State Univer- 
sity's expectations about freshman-level writing skills 
and consequently, to assist teachers to develop those 
skills. At present, these exams are being pilot-tested 
on selected groups of eleventh-grade students and from 
high schools in the UCLA>CSU-Northridge and the UC- 
Davis/csu-Sacramento service areas. In 1987, the 
numbers of students tested in each of these areas were 
522 and 789, respectively. 

Chemistry Diagnostic Testing Project: Beginning in 
fall I9f ^ 45-minute multiple-choice exams will be ad* 
ministered under the Chemistry Diagnostic Testing 
Project (CDTP) to diagnose the knowledge, skills, and 
abilities that students should possess if they are to suc- 
ceed in general chemistry. While the tests will serve 
both diagnostic and advising purposes, the intent is for 
the University, the State University and the Commu- 
nity Colleges to use them on a voluntary basis for 
placement purposes. It appears likely that most of the 
State's institutions will use the new CDTP exam stem* 
ming from their current dissatisfaction with the stan- 
dardized test they have used to date for advising and/or 
admissions purposes. 

The Entry -Level Mathematics Examination: The 
Entry-Level Mathematics Examination (elm), a multi- 
ple-choice test used by the California State University, 
assesses entering undergraduate students 1 entry-level 
skills in mathematics. While the major portion of the 
test covers algebra topics, the other portions relate to 
problems in arithmetic and geometry. The test serves 
to ensure that students have the mathematics skills re- 
quired to enroll in the General Education mathematics 
course. Consequently, students must pass the exami- 
nation if they are to complete their course of study to- 
ward a degree. Exempt students include those with 
scores above specified levels on standardized tests, 
such as the ACT and the SAT, which correlate highly 
with success on the ELM. 

The English Placement Test: The English Placement 
Test (EFT) is a multiple-choice essay test used by the 
California State University to assess the writing profi- 
ciency of its entering undergraduate students. The 
test, which specifically assesses skills in reading, sen- 
tence structure, logic and organization, and compo- 
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sition, is constructed by faculty of the State University 
and is instrumental for student placement in English 
coursework as well as for remediating identified defi- 
ciencies and eventually enabling students to satisfy 
the Graduation Writing Assessment Requirement. 
Exempt students include those with standardized test 
scores that correlated highly with success on the EPT. 

The English Equivalency Exam: The English Equiva- 
lency Exam consists of a 90-minute objective test on 
analysis and interpretation of literature and two 46- 
minute essay testa. The California State University 
administers the examination to its entering freshmen 
in order to grant them college-level English credit (a 
credit-by-examination policy) and/or to exempt these 
students from the State University English Placement 
Test 

The Subject A Examination: The University's system- 
wide Sutqect A examination is a two-hour essay exam- 
ination designed to assess students 1 writing proficiency 
in response to reading material characteristic of that 
assigned in beginning courses at the University. Its 
results are used for student placement in either fresh- 
man composition or Subject A courses. Exempted stu- 
dents are those who score 600 or better on the College 
Entrance Examination Board "English Composition 
Achievement Test* or an "Advanced Placement" En- 
glish core of 3, 4, or 5 by the April 1 preceding their 
freshman year. Several forms of the examination and 
sample papers published In the 1987 Information 
Booklet for the University-wide Subject A Examination 
and the forthcoming Report to High Schools on the 
1987 examination will serve to do outreach work with 
students and in-service work with teachers. 

Community Colleges Placement Testing: Community 
Colleges conduct comprehensive assessment in lan- 
guage, computation, and English as a second language 
for placement of students in college courses. Supple- 
mental assessment is provided on a voluntary basis in 
the areas of study skills, vocational aptitudes and in- 
terests, and related learning skills. While each college 
selects ; ts own set of assessment instruments and pro- 
cedures, all colleges use assessment results as one 
factor in advising students in the selection of their edu- 
cational programs. Following the passage of AB 3 in 
1986, the Statewide Matriculation Plan for Commu- 
nity Colleges was implemented in 1987-88. This plan 
provided funding for a six-component program of ad- 
mission, orientation, assessment, advisement, follow- 
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up, and evaluation available to each Community Col- 
lege student. As a result, Community Colleges are 
able to provide in-depth diagnostic assessment of stu- 
dents' basic skills, educational aspirations, and pro- 
gram goals. In conjunction with the implementation of 
the new matriculation program, Community Colleges 
are now engaged in an extensive reexamination of 
assessment practices and curriculum offerings. 

Recent 1987-88 survey information from the college 
matriculation plans submitted to the Chancellor's 
Office Management Information Systems Division 
shows that the following tests are commonly used in 
the 106 Community Colleges. (The numbers in Paren- 
theses indicate the number of colleges using the test.) 

Reading 

The College Board Comparative Guidance and 
Placement Examination (7) 

The College Board Assessment and Placement Ser- 
vices for Community Colleges (25) 

American College Testing Asset (35) 

Nelson-Denny (22) 

Writing/Composition 

The College Board Comparative Guidance and 
Placement Examination (6) 

The College Board Assessment and Placement Ser- 
vices for Community Colleges (26) 

American College Testing Asset (39) 

Writing Sample/Essay (85) 

Mathematics 

Mathematics Diagnostic Testing Project (16) 

The College Board Comparative Guidance and 
Placement Examination (5) 

The College Board Assessment and Placement Ser- 
vices for Community Colleges (21) 

American College Testing Asset (37) 

English as a Second Language 

Michigan Test of English Language Proficiency 
(Subcommittee on Student Assessment of the Cali- 
fornia Education Round Table, pp. 38-39). 

O 
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Assessment for and after 
completion of matriculation 

Skills Competency Testing: Many Community Col- 
leges conduct exit testing to ensure that their gradu- 
ates have achieved a specified level of competence in a 
discipline area. Most typically, competency assess- 
ment is done in English, mathematics, and in a num- 
ber of vocational areas. 

The Graduation Writing Assessment Requirement 
(GWAR) is a California State University systemwide re- 
quirement for graduation - to be satisfied at the junior 
level or above. It is designed to ensure that students 
are awarded a baccalaureate degree having demon- 
strated proficiency in writing skills. Students may sat- 
isfy this requirement by passing a locally developed 
and scored examination, a course, or a combination of 
the two. 

Comprehensive examinations for vocational and profes- 
sional certification, licensure, and graduate study: 
Nearly all California community colleges offer voca- 
tional programs in which comprehensive examinations 
are administered for certification or license. 

Graduates of the University and State University 
applying for admission to graduate degree programs 
are often selected on the basis of their performance on 
comprehensive examinations of their general and spe- 
cialized knowledge in their field. The passing rates on 
these exams provide the academic departments and 
the institutions with a valuable indicator of how well 
they prepared their students. In addition, students en- 
tering certain fields, such as nursing and teaching, 
must pass the comprehensive examinations to obtain 
the license or certificate required to practice in those 
fields. For example, the State's Board of Registered 
Nurses and its Commission on Teacher Credentialing 
control access to employment in California in the fields 
of nursing and teaching, respectively. Graduates' per- 
formance on State licensure examinations also are 
viewed as important indicators of the preparation they 
receive from their academic programs, the results of 
which are often used in the program review and ac- 
creditation processes. 

Seniors of the California Maritime Academy take a 
three-day multiple-choice examination administered 
by the U.S. Coast Guard that tests their maritime-re- 
lated education at the Academy- approximately 2 1/2 
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years of their four-yew curriculum - and that leads to 
the Issuance of a Coast Guard License. Graduates of 
the Academy receive both a Bachelor of Science degree 
and this license, and neither document can be obtained 
alone. The passing rate on the exam provides the 
Academy with internal monitoring of the quality of its 
graduates, since the Coast Guard itself sets the passing 
score on the test. Further, comparison of its passing 
rate with those of other state maritime academies 
across the country gives the Academy an objective 
comparative measure of the quality of its program. 

Sumy* of current and former student* 

The California Stat* University: The California State 
University is the State's only segment of higher educa- 
tion that conducts systemwide surveys of its current 
and former students. The "Student Needs and Priori* 
tie* Survey" (SNAPS) obtains information from current- 
ly enrolled students regarding: (1) life goals and educa- 
tional priorities; (2) levels of satisfaction with various 
aspects of their academic and social experience on cam- 
pus; and (3) problems or barriers, whether institution- 
al or personal in nature, which impede progress toward 
their educational goals. The data collected through 
this survey permit inter-campus and longitudinal com- 
parisons of student opinions and characteristics and 
they enable campuses to monitor the effects on student 
satisfaction resulting from changes in programs and 
support services. 

Since 1975, the State University has also conducted a 
biennial spring employment survey of all its graduates 
for the purpose of providing current and prospective 
ftudentSf faculty, and counselors with information on 
the employment of the State University's bachelor's 
and master's degree recipients relevant to career and 
life planning. The survey serves to document the 
status of students vno have successfully completed 
academic programs at the State University and assists 
the campuses to respond to the following questions: 

e What do CSU students do after graduation? 

e What are rates of employment for women, minori- 
ties and older graduates who seek employment? 

e Do CSU graduates get the jobs for which their major 
programs prepare them? 

• What are starting salaries fot- CSU graduates? 
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* How do CSU graduates find jobs? (California State 
University, 1987, p. 8) 

University of California: Several campuses of the Uni- 
versity of California conduct surveys to gauge different 
aspects of their students' undergraduate experience. 
These surveys are one of several information-gather- 
ing strategies used by these campuses to support their 
assessment activities. At the Riverside campus, stan- 
dardized student course ratings are designed to obtain 
student perceptions of the value of their learning in 
each course. In Fall 1985, the Irvine campus admin- 
istered the Quality of Student Life Survey to a strati- 
fied sample of its new students and repeated the survey 
the following fall that included all Student Affirmative 
Action admittees. 

The Berkeley, Santa Barbara, San Oiego and Davis 
campuses of the University conduct alumni surveys to 
determine their graduates' satisfaction with their un- 
dergraduate experience as well as to monitor postgrad- 
uate activities. Surveys of recent graduates of the 
Berkeley and San Diego campus showed that 91 per- 
cent and 95 percent of the respondents, respectively, 
were very satisfied with their overall campus experi- 
ence. At the Davis campus, the Student Affairs Re- 
search and Information Office periodically issues re- 
ports on student transfer and retention, program effec- 
tiveness, and quality of student services. Periodic sur- 
veys of Davis alumni have provided the campus with 
valuable insight into their graduates' satisfaction with 
their undergraduate experience, with a majority of 
them consistently reporting that their undergraduate 
studies provided them the basic tools to meet their edu- 
cational and career aspirations. 

California Community Colleges: Most of the California 
community colleges regularly conduct student satisfac- 
tion and follow-up surveys to ascertain student percep- 
tions about the value of the first two years of their 
undergraduate experience. A major longitudinal 
follow-up survey on a sample of 7,500 community col- 
lege freshmen examined student satisfaction with the 
skills and experience gained as a result of completing 
English courses. This survey was administered to stu- 
dents in one third of the community colleges; a second 
follow-up survey is being conducted in the skills area of 
reading; and the first year of a major mathematics 
study which investigates skills gains, student goal 
satisfaction and retention is in its first year. On an 
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annual basis, student follow-up is continuing on all of 
these identified subgroups. 

The "Statewide Student Follow-up Project" was initi- 
ated by the California Community Colleges in 1972 to 
obtain information on advanced occupational students 
over two consecutive years. The instruments used are 
the "Classroom Survey" and the "Follow-up Survey," 
which serve to obtain from students and former stu- 
dents information such as: their reasons for the 
courses they have taken, the nature of their work, 
their view of the usefulness of the skills provided them 
by the college, and their view of the general benefit 
they have derived from their classes and the college. 
To date, approximately 50 percent of the California 
Community Colleges have participated in the Project, 
but for the 1988-89 academic year it is projected that 
all of the institutions will be involved. 

Student assessment in the California Community Col- 
leges can accurately be described as in a "period of 
change." Community colleges are in the first year of 
implementing the Statewide Matriculation Plan. This 
legislated program has brought about a comprehensive 
review of assessment and placement procedures. Pro- 
posed revisions to the State Education Code adopted by 
the Board of Governors of the Community Colleges 
have led to a strengthening of academic standards and 
the associate degree (Board of Governors, 1987). These 
policies are being used to guide colleges in the follow- 
ing: 

• Developing operational definitions of "the full range 
of basic skills instruction and services"; 

• Establishing skill requisites for certificate and de- 
gree courses; 

• Providing method(s) for measuring a student's aca- 
demic progress, including clarification of the 
amount of basic skills instruction available to stu- 
dents; 

• Setting parameters for the scope of student assess- 
ment as required in matriculation and the rela- 
tionship of assessment to setting of course requi- 
sites. 

At the same time, the Board of Covemors adopted the 
Statewide Matriculation Plan (January, 1987), which 
describes the agreement made between each student 
and the community college that he or she attends for 
the purpose of realizing the students' need, the com- 
munity colleges provide: 



• An admissions process; 

• An orientation to college programs, services and 
procedures; 

• Preenrollment assessment and counseling; 

• Advisement and counseling for course selection; 

• Continuous follow-up on student progress with re* 
ferral to support services when needed; 

• A program of institutional research and evaluation. 

As an integral part of matriculation, comprehensive 
assessment in Community Colleges is based on the use 
of multiple measures to assess the basic skills of enter- 
ing students and their educational needs. The Chan- 
cellor has convened a statutory committee - the Ma- 
triculation Assessment Advisory Panel - to provide 
further guidelines, evaluative support, and technical 
assistance for Community College assessment prac- 
tices and procedures. (Subcommittee on Student As- 
sessment to the California Education Round Table, pp. 
39-40). 

Program review 

The California Community Colleges have systemwide 
procedures for reviewing two categoric U programs, the 
Extended Opportunity Programs and Services (EOPS) 
and the Disabled Students Programs and Services 
(DSPS), which have been in place for the past five years. 
In addition, the community colleges are reviewing de- 
gree and general education programs as a result of new 
proposed Title 5 standards for strengthening the asso- 
ciate degree. 

All campuses of the University of California and the 
California State University have established schedules 
for the qualitative review of existing programs on five 
to eight year intervals. The State University's formal 
requirement for a periodic review of each academic 
program at each campus has been in place since 1971 - 
making it among the first of its kind in the country. 
The requirement to review degree and general educa- 
tion programs is a systemwide policy for both Univer- 
sity systems and the California Community Colleges, 
yet the specific criteria and procedures for conducting 
the review vary a< :rding to campus. The University 
of California's regular faculty peer review of under- 
graduate programs has been an established component 
of its overall strategy for promoting program effective- 
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ness and the efficient allocation of resources consistent 
with the goals of the University. 

The program review process usually begins with a self- 
study by the department offering the program, which 
is then reviewed by a committee of college faculty and 
administrators. These self studies often involve sur- 
veys of students, faculty and alumni designed to offer 
observations on the programs' strengths and weak- 
nesses. External reviews, involving experts in the 
area of the discipline, are usually employed to provide 
more objectivity to the review process. 

The program review process serves to examine the 
goals and objectives of individual degree programs and 
the extent to which these have been achieved as well as 
to determine how the programs' effectiveness might be 
enhanced. For the moet part, program reviews have 
tended to emphasize "process* measures related to the 
program, such as coherence and breadth of the curricu- 
lum, faculty involvement in scholarly and community 
affairs, adequacy of the library and instructional 
equipment, counseling and other student support ser- 
vices. However, with the renewed national interest in 
student outcomes assessment, the "product 19 measures 
of the academic programs may assume added signif- 
icance. That is, there is a growing interest in incorpor- 
ating student outcomes assessment into the program 
review process as a means to better gauge the overall 
competence, skills, knowledge, and educational and 
career satisia*. of che programs' graduates. 

Institutional and programmatic accreditation 

In addition to the ongoing program review process de- 
scribed above, California postsecondary education in* 
stitutions rely on institutional and program accredita- 
tion as an indicator of excellence in education. Accred- 
itation is a non-governmental, voluntary process of 
evaluation of academic programs and institutions that 
has evolved to determine that educational quality has 
been maintained as measured against a set of predeter- 
mined standards. The primary purposes of accredita- 
tion are: 

1. To assure the education community, the gener- 
al public, and other organizations and agencies 
that an institution has clearly defined objec- 
tives appropri* .e to higher education and that 
it meets Commission standards; 
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2. To encourage institutional development and 
improvement through self study and periodic 
evaluation by qualified peer professionals; 

3. To develop and use standards to assess and en- 
hance educational quality and institutional 
performance, and to validate these standards 
by ongoing research; and 

4. To promote interchange of ideas among public 
and independent institutions through peer re- 
view. (Accrediting Commission for Senior Col* 
leges and Universities, 19118., p. 2) 

Degree programs of the State's* institutions are accred- 
ited by specialized agencies such a» the Accreditation 
Board for Engineering and Technology, the Commis- 
sion on Teacher Credentialing, and the American As- 
sembly of Collegiate Schools of Business. Specialized 
accreditation has aimed at ensuring program compli- 
ance with national standards designed to assure ade- 
quate professional preparation and that the programs' 
objectives have been met. Related to institutional 
accreditation, the State's Community Colleges and 
universities are accredited by the Accrediting Com- 
mission for Community and Junior Colleges and the 
Accrediting Commission for Senior Colleges and Uni- 
versities. Both Commissions operate under the aegis 
of the Western Association of Schools and Colleges 
(WASC) and are recognized by the Council on Post- 
secondary Education Accreditation (COP a), a nongov- 
ernmental agency representing most of the nation's 
accrediting bodies, and the U.S. Department of Educa- 
tion. Nine accreditation standards have been devel- 
oped to review the essential dimensions of an institu- 
tion of higher education: institutional integrity ; insti- 
tutional purposes, planning and effectiveness; gov- 
ernance and administration; educational programs, 
faculty and staff; library, computing, and other infor- 
mation and learning resources; student services and 
the co-curricular learning environment; physical re- 
sources; and financial resources. 

Each institution in the State undergoes a full accredi- 
tation review every ten years with follow-up reviews 
conducted mid- way to determine how well the institu- 
tion has responded to problems diagnosed in the full re- 
view. The accreditation pr r ~ess begins with the prepa- 
ration of a programmatic or institutional self-study 
report adhering to criteria and guidelines provided by 
the accrediting Commission. This report serves as the 
basis for evaluation, including a site visit to the insti- 
tution, by a team of peer evduato^s organized by the 



accrediting Commission. The site-visit team, repre- 
senting specialists appropriate to the type of institu- 
tion or program being reviewed, meets with adminis- 
trators, faculty, staff, and students to review the self- 
study report and to judge the extent to which the 
accreditation standards have been met by the program 
or institution. A Tnal team report with accompanying 
campus documentation is then prepared for the appro- 
priate accreditation commission which determines the 
accreditation status of the program or institution. 

In its report, The Master Plan Renewed: Unity, Equity , 
Quality, and Efficiency in California Higher Educa- 
tion, the Commission for the Review of the Master Plan 



for Higher Education made two recommendations 
aimed at strengthening the accreditation process. One 
called for programmatic accrediting agencies to ac- 
knowledge the larger institutional missions and pur- 
poses of undergraduate education as well as the im- 
portance of upholding the integrity of the general edu- 
cational curriculum. The other called on regional 
accrediting commissions to take sufficient cognizance 
of student outcomes in evaluating institutions. The 
latter recommendation echoes the national trends in 
which accreditation reviews have begun to emphasize 
the use of outcomes-based qualitative criteria by en- 
couraging institutions to undertake appropriate as- 
sessment initiatives. 
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CALIFORNIA POSTSECOND ARY EDUCATION COMMISSION 



THE Caiifornia Postsecondary Education Commis- 
sion is a citizen board established in 1974 by the 
Legislature and Governor to coordinate the efforts of 
California's colleges and universities and to provide 
independent, non-partisan policy analysis and rec- 
ommendations to the Governor and Legislature. 

Members of the Commission 

The Commission consists of 15 members. Nine rep- 
resent the general public, with three each appointed 
for six-year terms by the Governor, the Senate Rules 
Committee, and the Speaker of the Assembly. The 
other six represent the major segments of postsec- 
ondary education in California. 

As of January 1989, the Commissioners represent- 
ing the general public are: 

Mim Andelson, Los Angeles 

C. Thomas Dean, Long Beach 

Henry Der, San Francisco 

Seymour M. Farber, M.D., San Francisco 

Helen Z. Hansen, Long Beach 

Lowell J. Paige, El Macero, Vice Chairperson 

Cruz Reynoso, Sacramento 

Sharon N. Skog, Palo Alto, Chairperson 

Stephen P. Teale, M.D., Modesto 

Representatives of the segments are: 

Yori Wada, San Francisco; representing the Regents 
of the University of California 

Claudia H. Hampton, Los Angeles; representing the 
Trustees of the California State University 

John F. Parkhurst, Folsom; representing the Board 
of Governors of the California Community Colleges 

Harry Wugalter, Thousand Oaks; representing the 
Chairman of the Council for Private Postsecondary 
Educational Institutions 

Kenneth L. Peters, Tarzana; representing the Cali- 
fornia State Board of Education 

James B. Jamieson, San Luis Obispo; representing 
California's independent colleges and universities 



Functions of the Commission 

The Commission is charged by the Legislature and 
Governor to '"assure the effective utilization of public 
postsecondary education resources, thereby elimi- 
nating waste and unnecessary duplication, and to 
promote diversity, innovation, and responsiveness to 
student and societal needs." 

To this end, the Commission conducts independent 
reviews of matters affecting the 2,600 institutions of 
postsecondary education in California, including 
Community Colleges, four-year colleges, universi- 
ties, and professional and occupational schools. 

A? an advisory planning and coordinating body, the 
Commission does not administer or govern any insti- 
tutions, nor does it approve, authorize, or accredit 
any of them. Instead, it cooperates with other state 
agencies and non-governmental groups that perform 
these functions, while operating as an independent 
board with its own staff and its own specific duties of 
evaluation, coordination, and planning, 

Operation of the Commission 

The Commission holds regular meetings throughout 
the year at which it debates and takes action on staff 
studies and takes positions on proposed legislation 
affecting education beyond the high school in Califo- 
rnia. By law, the Commission's meetings are open to 
the public. Requests to address the Commission may 
be made by writing the Commission in advance or by 
submitting a request prior to the start of a meeting. 

The Commission's day-to-day work is carried out by 
its staff in Sacramento, under the guidance of its ex- 
ecutive director, Kenneth B. O'Brien, who is ap- 
pointed by the Commission. 

The Commission issues some 40 to 50 reports each 
year on major issues confronting California postsec- 
ondary education, and it makes these publications 
available without charge while ipplies last. 

Further information about the Commission, its meet- 
ings, its staff, and its publications may be obtained 
from the Commission offices at 1020 Twelfth Street, 
Third Floor, Sacramento, CA 98514; telephone (916) 
445-7933. 



BEYOND ASSESSMENT 
California Postsecondary Education Commission Report 88-41 



ONE of a series of reports published by the Commis- 
sion as paru J ? ts planning and coordinating respon- 
sibilities. Additional copies may be obtained without 
charge from the Publications Office, California Post 
secondary Education Commission, Third Floor, 1020 
Twelfth Street, Sacramento, California 95814-3985. 

Recent reports of the Commission include: 

88-27 °ropcsed Construction of Off-Campus Com- 
munity College Centers in Western Riverside Coun- 
ty: A Report to fhe Governor and Legislature in Re- 
sponse to a Request of the Riverside and Mt. San Ja- 
cinto Community College Districts for Capital Funds 
to Build Permanent Off-Campus Centers in Norco 
and Moreno Valley and South of Sun City (June 
1988) 

88*28 Annual Report on Program Review Activi- 
ties, 1986-87: The Twelfth in a Series of Reports to 
the Legislature and the Governor on Program Re- 
view by Commission Staff and California's Public 
Colleges and Universities (June 1988) 

88-29 Diversification of the Faculty and Staff in 
California Public Postsecondary Education from 
1977 to 1987: The Fifth in the Commission's Series 
Biennial Reports on Equal Employment Opportu- 
nity in California's Public Colleges and Universities 
(September 1988) 

88-30 Supplemental Report on Academic Salaries, 
1987-88: A Report to the Governor and Legislature 
in Response to Senate Concurrent Resolution No. 51 
(1965) and Subsequent Postsecondary Salary Legis- 
lation (September 1988) 

88-31 The Rc of the California Postsecondary Ed- 
ucation Commission in Achieving Educational Equi- 
ty in California: The Report of the Commission's Spe- 
cial Committee on Educational Eqiity, Cruz Reyno- 
so, Chair (September 1988) 

88-32 A Comprehensive Student Information Sys- 
tem, by John G. Harrison: A Report Prepared for the 
California Postsecondary Education Commission by 
the Wyndgate Group, Ltd. (September 1988) 

88-33 Appropriations in the 1988-89 State Budget 
for the Public Segments of Higher Education: A 
Staff Report to the California Postsecondary Educa- 
tion Commission (September 1988) 

88-34 Legislation Affecting Higher Education En- 
acted During the 1987-88 Session: A Staff Report to 
the California Postsecondary Education Cc emission 
(October 1988) 



88-35 Meeting California's Adult Education Needs: 
Recommendations to the Legislature in Response to 
Supplemental Language in the 1988 Budget Act (Oc- 
tober 1988) 

88-36 Implementing a Comprehensive Student In- 
formation System in California: A Recommended Plan 
of Action (October 1988) 

88-37 Proposed Establishment of San Jose State 
University's Tri-County ^enter in Salinas. A Report 
to the Governor and Legislature in Response to a Re- 
quest by the California State University for Funds to 
Create an Off-Campus Center to Serve Monterey, 
San Benito, and Santa Cruz Counties (October 1988) 

88*38 Progress in Implementing the Recommenda- 
tions of the Commission's 1987 Report on Strength- 
ening Transfer and Articulation: A Staff Report to 
the California Postsecondary Education Commission 
(October 1988) 

88-39 Proposition 98 - The Classroom Instruction 
Improvement and Accountability Act: A Staff Analy- 
sis for the California Postsecondary Education Com- 
mission (October 1988) 

88-40 The Fourth Segment: Accredited Indepen- 
dent Postsecondary Education in California. The 
Fifth in a Series of Reports on the Financial Condi- 
tion of California's Regionally Accredited Indepen- 
dent Colleges and Universities (December 1988) 

88-41 Beyond Assessment: Enhancing the Learning 
and Development of California's Changing Student 

Population. A Report in Response to the Higher Edu- j 

cation Talent Development Act of 1987 (Assembly ■ 

Bill 2016; Chapter 1296, Statutes of 1987) 'Decern- j 

ber 1988) | 

88-42 The Role of the Commission in Achieving Ed- j 
ucational Equity: A Declaration of Policy (December j 
1988) 

88-43 Education Needs of California Firms for Trade 
in Pacific Rim Markets: A Staff Report to the Califor- 
nia Postsecondary Education Commission (December 
1988) 

88-44 Distribution of Revenue from Concurrent En- 
rollment at the California State University: A Report 
to the Legislature in Response to Supplemental Lan 
guage to the 1988-89 Budget Act (December 1988) 

88-45 Prepaid College Tuition and Savings Bond 
Programs: A Staff Report to the California Postsec- 
ondary Education Commission (December 1988) 



